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Abstract 

A  real-time  recurrent  learning  algorithm  was  applied  to  a  five  class  radar  target 
identification  problem.  The  wideband  radar  was  assumed  to  measure  both  kinematic 
(tracking  information  expressed  as  estimated  aspect  angles)  and  high  range  resolution 
data  from  a  single,  isolated  aircraft.  The  aspect  angles  (azimuth  and  elevation)  of  the 
aircraft  relative  to  the  radar  were  assumed  to  be  constantly  changing.  This  created 
temporal  sequences  of  high  range  resolution  radar  signatures  that  changed  as  the  aspect 
angles  changed.  These  sequences  were  used  as  input  features  to  a  recurrent  neural 
network  for  three  radar  target  identification  test  cases.  The  first  test  case  demonstrated 
the  feasibility  of  using  recurrent  neural  networks  for  radar  target  identification.  The 
second  test  case  demonstrated  the  relationship  between  sequence  length  and  target 
recognition  accuracy.  For  the  third  test  case,  the  recurrent  net  achieved  96%  test  set 
accuracy  under  the  following  conditions:  5  aircraft  classes,  azimuth  range  between  60** 
and  90®,  elevation  range  between  +5®  and  -5®,  1®  signature  granularity,  and  signatures 
corrupted  by  5  dBsm  scintillation  noise. 
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RECURRENT  NEURAL  NETWORKS 
FOR  RADAR  TARGET  IDENTIHCATION 


/.  Introduction 

1.1  Background 

Aircraft  surveillance  is  an  important  Air  Force  mission.  This  mission  can  be 
divided  into  three  functions:  detection,  tracking,  and  identification.  These  functions 
must  often  be  performed  at  long  ranges  and  under  adverse  weather  conditions,  so  radar 
is  an  obvious  sensor  choice.  Current  radar  systems  can  detect  and  track  aircraft  under  a 
wide  range  of  operational  conditions.  This  thesis  focuses  on  the  identification  function. 

1.1.1  Identification  Approaches.  Radar  target  identification  is  an  active 
research  area,  with  many  different  available  approaches  [Cohen,  1991:233-242].  In 
each  apfKoach,  identification  generally  proceeds  in  four  steps:  sensor  nneasurement, 
signal  processing,  feature  extraction,  and  decision  processing  [Cohen,  1991:241].  Fw 
sensor  measurement,  a  surveillance  radar  emits  a  signal  towards  a  target  and  measures 
the  reftected  radar  signature.  For  signal  processing,  a  radar  receiver  converts  antenna 
measurements  into  a  large  set  of  parameters  to  represent  the  radar  signature.  After 
signal  processing,  the  radar  signature  may  be  represented  by  hundreds  or  even 
thousands  of  parameters.  For  feature  extraction,  an  algorithm  (in  hardware  or  software) 
performs  data  reduction  or  data  compression.  After  feature  extraction,  the  radar 
signature  is  typically  represented  by  tens  of  parameters  or  less.  For  decision 
processing,  an  algorithm  (usually  in  software)  identifies  the  target  based  on  information 
contained  within  a  single  radar  signature  or  within  multiple  radar  signatures. 

This  thesis  focuses  on  developing  a  decision  processing  algorithm  for  radar 
target  identification.  Stealth  technology,  impulse  radar,  bistatic  radar,  synthetic 
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apeiture  mode  radar,  and  man-in-the-loop  systems  are  not  discussed.  Following 
sectious  assume  that  the  sensor  measurement  and  signal  processing  steps  have  already 
been  performed. 

7.7.2  Radar  Signature  Parameters.  A  radar  signature  can  be  described  by 
three  types  of  parameters:  frequency,  polarization,  and  amplitude  [Trebits,  1984:27- 
31].  Amplitude  values  are  determined  by  interactions  between  a  radar  signal  and  a 
target.  These  interactions  are  dependent  on  the  frequency  and  polarization  parameters 
as  set  by  the  radar.  Amplitudes  are  often  presented  as  a  radar  cross  section,  measured 
in  decibels  relative  to  a  hypothetical  one  square  meter  target  (dBsm)  viewed  under  the 
same  operational  conditions  (transmit  power,  antenna  gain,  range,  etc.)  [Stimson, 
1983:115,  170-174].  A  radar  can  measure  amplitudes  at  a  single  frequency  (ftx^ 
narrowband  radar)  or  over  a  range  of  frequencies  (f(»‘  wideband  radar).  Antenna 
polarizations  can  be  vertical,  horizontal,  circular  left,  circular  right,  or  elliptical. 
Differmt  polarizations  may  be  used  during  the  transmit  and  receive  cycles.  If  a  radar 
transmits  two  signals  (using  oithogonal  polarizations)  and  receives  each  signal  twice 
(using  the  same  orthogonal  polarizations),  then  the  resulting  radar  signature  is  fully 
polarized.  A  frilly  polarized  radar  signature  contains  all  available  radar  information 
about  a  target  [Trebits,  1984:30]. 

7.7.5  Polarization  Diverse  Radar  Signature.  For  most  radar  targ^ 
identificaticm  cases,  it  is  not  necessary  to  measure  a  fully  polarized  radar  signature.  If  a 
radar  transmits  a  circularly  polarized  signal  and  receives  using  orthogonal  linear 
polarizatirais,  then  the  resulting  radar  signature  is  polarization  diverse  [Sacchini, 
1992a:127].  A  polarization  diverse  radar  signature  is  a  compressed  form  of  a  fully 
polarized  signature,  with  some  loss  of  information.  This  information  loss  is  negligible 
as  long  as  the  target  does  not  respond  preferentially  to  one  circular  polarization  and  not 
the  other  [Sacchini,  1992:127].  This  thesis  will  assume  all  radar  »gnatures  are 
polaiizatirm  diverse  (using  left  circular  transmit  polarization)  unless  specifically  noted 
otherwise. 
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1.1.4  Narrowband  Radar.  For  narrowband  radar,  the  measured  amplitudes  ate 
vector-sum  values  for  the  entire  target.  A  polarization  diverse,  narrowband  radar 
signature  contains  two  parameters:  the  LV  amplitude  for  the  left  circular  transmit  - 
vertical  receive  polarization,  and  the  LH  amplitude  for  the  left  circular  transmit  - 
horizontal  receive  polarization. 

1.1.5  Wideband  Radar.  For  wideband  radar,  amplitude  values  are  measured  at 
veiy  precise,  discrete  times  to  gain  additional  information  about  a  target.  Since  radar 
waves  travel  at  the  speed  of  light,  measurements  over  discrete  time  intervals  correspond 
to  discrete  range  intervals  (or  range  bins)  across  the  target  (Figure  1-1).  Amplitude 
values  are  measured  for  each  range  bin  as  if  it  were  an  individual  radar  target.  A 
polarization  diverse,  wideband  (or  high  range  resolution)  radar  signature  is  a  matrix 
containing  LV  and  LH  amplitudes  for  each  range  bin  across  the  target. 


Figure  1-1:  Range  Bins  for  Wideband  Radar  [Mensa,  1991:6] 


1.1.6  Aspect  Angle  Dependence.  A  radar  signature  measures  the  radar 
reflective  properties  of  an  aircraft.  However,  these  reflective  properties  change  as  the 
aitctafr  is  viewed  from  different  aspect  angles  (azimuth  and  elevation)  [Trebits, 
1984:44].  Ftn*  this  thesis,  azimuth  and  elevation  are  measured  in  the  aircraft  frame  of 
reference  from  the  aircraft  towards  a  radar  (Hgure  1-2).  A  given  aircraft  viewed  at 
given  aspect  angles  will  produce  a  particular  radar  signature  (Fgures  1-2  and  1-3).  If  a 
given  signature  is  unique  to  a  particular  aircraft  class,  then  a  decision  processing 
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algorithm  can  identify  that  aircraft  based  on  the  information  contained  within  a  single 
radar  signature.  However,  this  "unique  signatures"  condition  is  not  often  encountered 
with  real  radar  targets.  Radar  signatures  from  different  aircraft  are  sometimes 
essentially  identical  at  the  same  or  different  aspect  angles  [Libby,  1992a:Ch  1,  6-8]. 
When  this  happens,  additional  information  must  be  measured  before  an  aircraft  can  be 
identified. 


Figure  1-2:  Aspect  Angle  Sequence  [Libby,  1992a:Ch  1, 9] 


Amplitude 


Aspect  Angle 
Number  From 


Range  Bins  Rgure  1-2 

Rgure  1-3:  Sequence  of  Wideband  Radar  Signatures 


1.1.7  Aspect  Angle  Sequences.  Existing  radars  can  provide  this  additional 
information  [Libby,  1992a:Ch  1,  6-8].  Since  an  aircraft  in  flight  is  constantly  in 
motkMi,  a  radar  can  measure  sequences  of  radar  signatures  as  the  aspect  angles  change 
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(Figures  1-2  and  1-3).  A  sequence  of  radar  signatures  is  much  more  likely  to  be  unique 
than  its  component  signatures.  There  are  an  infinite  number  of  possible  aspect  angle 
sequences,  so  a  priori  aspect  angle  estimates  are  needed  to  limit  the  number  of 
candidate  sequences.  A  radar  can  generate  these  aspect  angle  estimates  by  using 
kinematic  information  from  aircraft  position  and  velocity  measurements.  The  aspect 
angle  estimates  and  temporal  sequences  of  radar  signatures  are  additional  features  that 
can  be  used  to  discriminate  between  aircraft  classes. 

1.2  Problem 

The  goal  of  this  thesis  is  to  identify  various  types  of  aircraft  using  sequences  of 
high  range  resolution  radar  signatures. 

1.3  Summary  of  Current  Knowledge 

Only  a  few  radar  target  identification  algorithms  have  been  developed  that  use 
sequences  of  radar  signatures  (temporal  sequences  based  on  target  aspect  angle 
changes).  These  algorithms  include  an  optical  neural  network  [Faihat,  1989:670-680], 
a  quadratic  classifier,  a  backpropagation  neural  network,  and  a  counterpropagation 
neural  network  (the  last  three  by  [Brown  and  others,  1990:217-224]).  However,  there 
are  other  algorithms  from  classical  sequence  analysis  disciplines  that  have  not  yet  been 
used  for  radar  target  identification  [Ubby,  1992b].  These  algorithms  include  hidden 
Maikov  models  and  recurrent  neural  networks.  Since  hidden  Markov  models  [DeWitt, 
1992:Ch  1,  1]  and  other  stochastic  estimation  techniques  [Libby,  1992a:C3i  1,  11]  for 
radar  target  identification  are  currently  under  research  here  at  AFTT,  this  thesis  focuses 
on  recurrent  neural  netwoiks. 

1.4  Assumptions 

-  The  radar  operates  at  10  GHz  frequency  with  a  1  GHz  bandwidth. 

-  Radar  signatures  are  measured  in  the  time  domain  from  a  single,  isolated 
aircraft. 

-  The  aircraft  aspect  angles  are  changing  at  a  constant  rate. 
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-  Radar  signatures  are  strong  enough  to  be  clearly  seen  above  thermal  noise. 

-  Radar  signatures  are  corrupted  only  by  scintillation  effects. 

1.5  Scope 

This  thesis  focuses  on  solving  a  five  class  radar  target  identification  problem  by 
using  recurrent  neural  networks  [Lindsey,  1991:1-3]  [Williams  and  Zipser,  1989:270- 
280]. 

1.6  Approach 

Radar  target  identification  using  recurrent  neural  networks  was  performed  in 
three  steps.  First,  the  RCS_T(X)LBOX  computer  program  generated  a  database  of  high 
range  resolution  radar  signatures  (provided  by  MIT  Lincoln  Laboratories  Group  93 
[Bramley  and  others,  1991]).  Second,  these  signatures  were  processed  into  sequences 
of  feature  values  for  use  during  recurrent  neural  network  training  and  testing.  Third,  a 
recurrent  neural  network  computer  program  (implementing  a  real  time  recurrent 
learning  algorithm)  was  trained  to  recognize  sequences  of  radar  signatures  from 
different  aircraft  classes  [Lindsey,  1991:58-74].  Radar  target  identification  accuracy 
was  verified  against  an  independent  set  of  RCS_TCX)LBOX  test  sequences. 

1.7  Organization 

The  remaining  sections  of  this  thesis  are  organized  into  four  chapters.  (Chapter 
n  discusses  several  important  radar  concepts  and  summarizes  a  few  decision  processing 
algorithms  that  can  use  sequences  of  radar  signatures  for  radar  target  identification. 
Cluster  in  presents  the  procedures  for  generating  radar  signatures,  adding  noise, 
extracting  feature  values,  training  a  recurrent  neural  networic,  and  testing  for 
identification  accuracy.  Chapter  IV  ^ves  the  experimental  results  for  three  test  cases. 
Ouster  V  gives  conclusions  and  recorrunendations  for  future  research. 
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11.  Literature  Review 


2.1  Introduction 

This  chapter  discusses  several  important  radar  concepts  that  apply  to  this  thesis: 
scattering  centers,  scintillation,  narrowband  radar,  wideband  range  resolution,  wideband 
range  extent,  thermal  noise,  and  aspect  angle  estimates.  This  chapter  also  summarizes  a 
few  decision  processing  algorithms  that  can  use  sequences  of  radar  signatures  for  radar 
target  identification.  If  an  algorithm  has  been  used  previously  for  radar  target 
identification,  the  associated  data  files,  algorithm  results,  and  limitations  are  discussed. 

2.2  Radar  Concepts 

A  radar  signature  is  created  by  interactions  between  a  radar  signal  and  a  target. 
These  interactions  are  a  function  of  geometry  between  the  radar  and  target,  and 
reflectivity  properties  of  the  target  at  the  radar  signal  frequency  and  polarization 
[Barton,  1988:108].  For  simple  targets  (spheres,  plates,  cylinders,  cones,  and  comer 
reflectors),  radar  signatures  can  be  analytically  or  approximately  computed  [Trebits, 
1984:31-43].  For  complex  targets  such  as  aircraft,  radar  signatures  must  be  either 
physically  measured  or  numerically  estimated  [Barton,  1988:109].  This  thesis  uses  the 
RCS.TOOLBOX  computer  program  to  numerically  estimate  radar  signatures 
[Bramley  and  others,  1991]. 

2.2.7  Scattering  Centers.  A  complex  target  can  be  viewed  as  a  set  of  small, 
siiiq)le  targets  (scattering  centers)  [Trebits,  1984:44].  The  radar  signature  for  each 
scattering  center  can  be  computed,  so  the  radar  signature  for  a  complex  target  can  be 
numerically  estimated  by  coherently  summing  the  individual  radar  signatures  from  the 
comptHient  scattering  centers.  This  coherent  sum  is  based  on  the  addition  and 
cancellation  of  scattering  center  amplitudes  as  adjusted  by  each  scattering  center’s 
phase.  Each  scattering  center  can  have  different  reflectivity  properties,  depending  on 
materials  used  for  that  part  of  the  target.  Particular  scattering  centers  may  be  partially 
or  coiiq)letely  obscured  when  the  target  is  viewed  from  certain  aspect  angles:  these 


2-1 


effects  must  be  accounted  for  using  three-dimensional  geometry.  Interference  effects 
(caused  by  multiple  radar  signal  bounces  between  scattering  centers)  may  be  included 
for  accuracy  or  ignored  for  computational  speed:  RCS.TOOLBOX  ignores 
interference  effects. 

2.2.2  Scintillation.  Scintillation  is  a  problem  for  radar  target  identification.  It 
causes  a  radar  signature  to  vary  tt^idly  with  time  and  with  target  aspect  angle.  It  is 
caused  by  scattering  center  amplitude  and  phase  variations  and  by  interactions  between 
returns  from  individual  scattering  centers  [Stimson,  1983:192-193].  Amplitude  and 
phase  variations  can  happen  for  a  variety  of  reasons:  control  surface  motion,  rotating 
propellers,  structural  flexing,  vibrations,  atmospheric  effects,  etc.  If  a  scattering  center 
is  rotated  by  a  small  amount,  then  its  amplitude  will  change.  If  a  scattering  center 
moves  along  the  line  of  sight  between  the  aircraft  and  radar,  then  its  phase  will  change. 
Slight  motions  are  sufficient  to  cause  large  phase  changes:  a  10  GHz  radar  operates  at  a 
3  cm  wavelength,  and  a  quarter  wavelength  shift  will  change  a  scattering  center’s  phase 
by  180**  [Stimson,  1983:86,192-193].  As  the  amplitude  and  phase  values  change,  the 
total  amplitude  for  the  target  will  change.  For  this  thesis,  scintillation  effects  were 
included  as  the  primary  source  of  radar  system  noise.  RCS.TOOLBOX  computed 
noise-free  radar  signatures,  so  scintillation  effects  had  to  be  added  using  a  separate 
computer  program  (FORMAT_RCST,  as  described  in  Section  3.3.3). 

2.2.3  Narrowband  Radar.  For  narrowband  radar,  all  scattering  center 
signatures  from  a  complex  target  are  coherently  summed  into  a  single  "range  bin".  For 
this  reason,  scintillation  makes  narrowband  signatures  fluctuate  rapidly  with  time  and 
aspect  angle.  This  also  makes  narrowband  signatures  a  poor  feature  set  for  aircraft 
identification. 

2.2.4  Wideband  Radar  Range  Resolution.  Foe  wideband  radar,  range 
resolution  is  a  measure  of  how  closely  two  targets  may  be  placed  (along  the  line  of 
sight  between  the  radar  and  the  targets)  before  the  two  radar  signatures  begin  to 
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overlap.  It  is  determined  by  the  radar  signal  bandwidth  [Mensa,  1991:9].  For  complex 
targets,  the  range  resolution  parameter  e^ectively  divides  the  object  into  range  "bins". 
The  radar  signatures  from  scattering  centers  within  the  same  range  bin  will  be 
coherently  sununed  into  a  single  signature  for  that  range  bin.  This  makes  wideband 
radar  resistant  to  scintillation  effects  [Skolnik,  1980:181-182].  Scintillation  still  causes 
random  fluctuations  in  the  scattering  center  radar  signatures,  but  the  effects  are 
contained  within  individual  ranges  bins. 

2.2.5  Wideband  Radar  Range  Extent.  A  polarization  diverse,  wideband  radar 
signature  is  a  matrix  containing  LV  and  LH  amplitudes  for  each  range  bin  within  the 
range  extent.  Range  extent  is  the  window  of  ranges  over  which  a  wideband  radar  will 
measure  target  information.  A  complete  discussion  of  the  factors  affecting  range  extent 
is  beyond  the  scope  of  this  thesis.  In  any  case,  range  extent  must  be  large  enough  to 
completely  cover  a  target.  For  most  aircraft,  a  range  extent  on  the  order  of  tens  of 
meters  is  sufficient. 

2.2.6  Thermal  Noise.  Thermal  noise  is  present  in  the  output  of  every  radar 
receiver.  The  total  noise  power  level  can  be  expressed  as  the  finite  sum  of  noise 
contributions  from  the  atmospheric  background,  antenna,  transmission  lines,  and 
receiver  [Stimson,  1983:169].  For  wideband  radar,  the  finite  noise  power  level  causes 
each  range  bin  to  contain  a  finite  amount  of  noise  energy.  This  noise  energy  (in  joules) 
can  be  expressed  as  an  equivalent  noise  amplitude  (in  dBsm)  by  figuring  out  how  much 
energy  would  be  measured  from  a  hypothetical  one  square  meter  target  (for  a  given 
radar  under  specific  operating  conditions)  [Barton,  1988:16].  For  a  target  scattering 
center  to  be  detected,  the  energy  in  that  range  bin  due  to  the  scattering  center  must  be 
greater  than  the  energy  due  to  noise.  Noise  effects  can  be  filtered  out  of  a  radar 
signature  by  setting  an  amplitude  threshold  value:  anything  below  the  threshold  is 
ctmsidered  to  be  noise  and  anything  above  it  is  part  of  a  target  [Stimson,  1983:175]. 
Ftxr  this  thesis,  the  amplitude  threshold  was  assumed  to  be  high  enough  to  filter  out  all 
thormal  noise  effects. 
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2.2.7  Aspect  Angle  Estimates.  Tracking  information  (position  and  velocity) 
can  be  used  to  estimate  aspect  angles  by  assuming  an  aircraft  is  constrained  to 
aerod^amic  flight.  Basic  geometry  can  provide  these  estimates  by  assuming  the 
aircraft  is  in  straight,  level,  upright,  zero  angle-of-attack  flight.  Advanced  techniques 
(Kalman  filters  and  coordinate  transformations)  are  required  to  handle  the  more  general 
cases  [Bogler,  1990:147-199]  [Libby,  1992a:Ch  3, 13-21]. 

Two  types  of  aspect  angle  uncertainty  are  required  to  model  a  radar  target 
tracking  algorithm  [Libby,  1992b].  First,  there  is  an  overall  "bias"  uncertainty  that 
causes  an  offset  between  the  target  actual  and  estimated  aspect  angles.  It  is  caused 
mainly  by  uncertainty  in  the  aircraft’s  aspect  angle  relative  to  its  velocity  vector 
(sideslip  angle,  angle  of  attack,  etc.).  The  offset  error  affects  all  aspect  angle  estimates 
for  a  given  target  and  will  persist  over  a  sequence  of  radar  measurements.  The  offset 
error  can  have  a  standard  deviation  of  as  much  as  a  few  degrees:  this  accounts  for  most 
of  the  uncertainty  within  a  tracking  algorithm  [Libby,  1992b].  The  second  type  of 
uncertainty  causes  small,  random  deviations  from  the  target’s  apparent  aspect 
trajectory.  It  is  caused  mainly  by  high  frequency  aerodynamic  effects  (aircraft  control 
response,  wind  buffeting,  etc.).  For  a  typical  sequence  of  wideband  radar  signatures, 
these  deviations  ate  uncorrelated  in  time  [Libby,  1992b].  In  stable  flight,  these  random 
fluctuations  are  expected  to  have  a  standard  deviation  of  less  than  one  degree  [Libby, 
1992b]. 

For  current  radar  systems,  aircraft  azimuth  and  elevation  angles  can  be 
estimated  within  ±  S**  (including  both  types  of  uncertainty)  [Libby,  1992b].  A  decision 
processing  algorithm  should  take  advantage  of  every  possible  source  of  information, 
therefore  this  thesis  uses  the  aspect  angle  estimates  as  feature  values. 

2.3  Decision  Processing  Algorithms 

This  section  describes  several  decision  processing  algorithms  that  can  use 
sequences  of  radar  signatures  for  radar  target  identification.  If  the  algorithm  has  been 
used  previously  for  radar  target  identification,  the  associated  data  files,  algorithm 
results,  and  limitations  are  discussed. 
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2.3.1  Recurrent  Neural  Network.  Williams  and  Zipser  developed  a  recurrent 
neural  network  algorithm  that  can  learn  supervised  temporal  tasks  [Williams  and 
Zipser,  1989:270-280].  This  algorithm  has  been  used  previously  for  function  prediction 
[Lindsey,  1991:2]  and  word  recognition  [Robinson,  1992],  but  not  for  radar  target 
identification.  Similar  to  other  neural  nets,  a  recurrent  net  multiplies  an  input  vector  by 
a  weight  matrix  to  get  an  output  vector  (a  computationally  simple  operation).  For  radar 
target  identification,  the  input  vector  is  a  set  of  numbers  representing  a  radar  signature 
(the  amplitudes  from  a  polarization  diverse  signature).  Aspect  angle  estimates  are 
included  as  separate  feature  values  in  the  input  vector.  The  weight  matrix  is  trained 
using  labeled  input  vectors  and  gradient  descent:  this  process  minimizes  the  mean- 
squared  error  between  the  desired  and  actual  output  vectors.  The  output  vector  includes 
both  output  nodes  and  hidden  nodes.  The  index  of  the  maximum  value  within  the 
output  nodes  identifies  the  target. 

To  process  temporal  sequences,  the  output  vector  for  a  given  time  step  is  fed 
back  as  additional  inputs  for  the  next  time  step.  The  input  vector  includes  the  aspect 
angles  and  radar  signature  values  for  the  current  iteration  and  the  output  vector  as 
calculated  during  the  previous  iteration.  Output  vectors  are  computed  for  each  time 
step. 

Recurrent  nets  appear  to  be  ideally  suited  for  processing  sequences  of  radar 
signatures  for  two  reasons.  First,  sequences  may  contain  an  arbitrary  number  of 
signatures.  Second,  a  recurrent  net  will  retain  temporal  information  for  flxed  or 
indefinite  periods  of  time  as  required.  The  biggest  limitation  for  recurrent  nets  is 
computational  speed  during  training  (but  not  testing)  [Lindsey,  1991:9-10]. 

2.3.2  Farhat:  Optical  Neural  Network.  Fartiat  developed  an  optical  neural 
netwrxk  algorithm  (based  on  a  feed-forward  net,  not  a  recurrent  net)  that  uses 
sequences  of  wideband  radar  signatures  to  identify  airborne  targets  [Farhat,  1989:670- 
680].  Similar  to  other  neural  nets,  it  multiplies  an  input  vector  by  a  weight  matrix  to 
get  an  output  vector.  However,  this  algorithm  performs  all  of  its  operations  optically. 
The  input  vector  is  a  sinogram,  which  is  a  Cartesian  plot  of  the  radar  intensities  of 
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scattering  centers  on  a  target  versus  target  aspect  angle  (sinular  to  Hgure  1-3).  Each 
sinogram  is  converted  into  a  2-dimensional  binary  image  representing  an  entire  radar 
sequence.  The  weight  matrix  is  computed  (not  trained)  by  converting  a  complete  set  of 
2-dimensional  training  images  into  a  4-dimensional  connectivity  matrix.  The 
connectivity  matrix  is  partitioned  back  into  a  2-dimensional  representation  for  optical 
storage  on  a  hologram.  The  output  vector  is  an  optical  text  label  that  identifies  the 
target. 


2.3. 2.1  Farhat:  Data.  Training  and  test  sequences  were  measured  for 
three  target  classes:  a  B-S2.  an  AWACS,  and  a  Space  Shuttle.  Real  data  sets  were 
obtained  by  placing  three  physical  models  on  a  turntable  in  a  radar  test  range  (16  GHz 
to  17  GHz,  wideband).  Fully  polarized  signatures  were  measured  for  each  target. 
Aspect  angle  changes  were  limited  to  azimuth  only.  Training  sequences  were  measured 
for  each  azimuth  quadrant:  these  were  converted  into  sinograms  and  digitized  into  32 
by  32  pixel  binary  images.  Test  sequences  were  generated  by  windowing  the  azimuth 
axis  of  the  binary  images.  2^ro  padding  filled  out  the  rest  of  the  test  images. 

2.3.2.2  Farhat:  Results.  Target  identification  was  accurate  for  test 
sequences  with  18**  or  more  of  azimuth  angle  changes.  Accuracy  losses  were 
noticeable  for  test  sequences  with  9*’  azimuth  angle  changes.  These  results  apply  to  a 
three  class  identification  problem  with  azimuth  angles  known  exactly.  Note:  Farhat 
did  not  explain  how  the  azimuth  angle  measurements  would  be  obtained. 

2.3.2.3  Farhat:  Limitations.  Data  storage  is  the  biggest  limitation  fcv 
the  Farhat  algorithriL  The  optical  storage  algorithm  can  retain  approximately  37  images 
(each  32  by  32  pixels)  without  degradation  [Farhat,  1989:675].  Each  image  stores 
information  for  a  90^  azimuth  angle  change  for  a  single  target.  Therefore,  the  Farhat 
algorithm  can  be  "saturated"  by  measuring  the  radar  signatures  from  three  targets  for  a 
full  360**  azimuth  rotation  at  three  discrete  elevation  angles  (36  images  total).  The 
Farirat  algorithm  can  be  modified  to  store  mote  images,  but  there  will  always  be  an 
upper  limit  for  a  given  system:  this  is  less  than  optimal  because  a  radar  targ^ 
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identificadon  system  should  be  able  to  handle  many  targets  and  a  potentially  infinite 
number  of  aspect  angle  sequences  [Cohen,  1991:238]. 

2.3.3  Brown:  Quadratic  Classifier,  Backpropagation  Neural  Network,  and 
Counterpropagation  Neural  Network.  Brown  developed  three  algorithms  that  use 
fixed-length  sequences  of  narrowband  radar  amplitudes  to  identify  three  classes  of 
ground  targets  [Brown  and  others,  1990:217-224]. 

The  first  algorithm  is  a  quadratic  (Bayesian-like)  classifier.  It  computes  the 
probability  that  a  particular  target  is  present  given  that  a  particular  radar  sequence  has 
been  received.  This  algorithm  measures  tt»  Mahalanobis  distance  between  an 
unknown  sequence  (a  vector  of  radar  amplitudes)  and  all  known  sequences.  The 
minimum  distance  identifies  the  target. 

The  second  algorithm  is  a  multi-layer  perceptron  neural  network.  It  multiplies 
an  input  vector  by  two  weight  matrices  (two  layers  of  hidden  nodes)  to  get  an  output 
vecUx*.  The  input  vector  is  a  set  of  numbers  that  represent  the  amplitudes  of  a  radar 
signature.  The  weight  matrices  are  trained  using  labeled  input  vectors  and  gradient 
descent:  this  process  minimizes  the  mean-squared  error  between  the  desired  and  actual 
output  vectors.  The  index  of  the  maximum  value  within  the  output  vector  identifies  the 
target. 

The  third  algorithm  is  a  counterpropagation  neural  network  that  combines  a 
Kohonen  map  and  a  Grossbetg  outstar  net.  This  algorithm  is  trained  with  methods 
similar  to  those  used  for  a  backpropagation  net.  After  training,  the  Kohonen  map  takes 
an  input  vectm:  and  maps  it  to  an  intermediate  feature  space  of  discrete  nodes.  These 
nodes  represent  the  discrete  probability  density  function  of  all  input  vectors.  The 
Gfossb^  outstar  net  approximates  a  look-up  table  and  labels  each  Kohonen  node: 
these  labels  identify  the  target. 

2.3.3. 1  Brown:  Data.  Training  and  test  sequences  were  measured  for 
three  classes:  a  tank,  a  truck,  and  an  armored  personnel  carrier.  Real  data  sets  were 
obtained  by  placing  three  physical  models  on  a  turntable  in  a  radar  test  range  (35  GHz, 
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narrowband).  Fully  polarized  signatures  were  measured  for  each  target.  Aspect  angle 
changes  were  limited  to  azimuth  only.  Radar  sequences  were  represented  by  a  vector  of 
8  feature  values  (for  the  quadratic  classifier)  or  21  feature  values  (for  the  neural 
networks);  Brown  did  not  specifically  identify  what  these  values  represented.  A  total 
of  2932  sequences  were  measured:  half  for  tmining  and  half  for  testing. 

2. 3. 3. 2  Brown:  Results.  The  average  quadratic  classifier  accuracy  was 
73%  for  a  three  class,  rotation-invariant  problem.  The  average  backpropagation  net 
accuracy  was  74%.  The  average  counteipropagation  net  accuracy  was  70%.  The 
neural  network  results  apply  to  a  four  class  (three  targets  plus  "unidentified"),  rotation- 
invariant  problem.  Brown  identified  the  backpropagation  net  as  having  the  best 
potential. 


2.3.3.3  Brown:  Limitations.  The  fixed  sequence  length  is  the  biggest 
limitation  for  the  Brown  backpropagation  algorithm.  The  sequence  length  is  defined  by 
the  input  vector  size,  so  the  training  and  testing  vectors  for  a  given  net  architecture  must 
be  the  same  length.  This  means  the  appropriate  sequence  length  (to  maximize  radar 
tai:get  identification  accuracy)  for  a  backpropagation  net  can  be  found  only  by  trial  and 
error  during  training.  Recurrent  neural  networks  are  more  efficient  for  sequence  length 
aiuilysis:  a  recurrent  net  outputs  the  estimated  target  identity  at  each  time  step  during  a 
sequence  [Williams  and  Zipser,  1989:271]. 

2.3.4  Hidden  Markov  Models.  Hidden  Maricov  nxxlels  have  been  used  in  the 
past  for  isolated  word  recognition  [Parsons,  1987:307-317]  and  have  only  recently 
been  proposed  for  radar  target  identification  [Libby,  1992a:Ch  3,  49-50].  For  aircraft 
identification,  a  hidden  Markov  model  assumes  a  system  (aircraft)  must  be  in  one  of  a 
finite  number  of  states  (aspect  angles)  and  that  each  state  has  a  finite  number  of 
possible  outputs  (radar  signatures)  [DeWitt,  1992:Ch  3,  9-1 1].  The  system  transitions 
thfou^  a  sequence  of  states  and  each  state  emits  an  output.  The  transitions  and  outputs 
are  assumed  to  be  random  with  defined  probabilities.  Therefore,  a  sequence  of 
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measured  outputs  can  be  analyzed  to  see  if  they  match  the  possible  outputs  from  a 
given  system.  The  best  possible  match  identifies  the  system. 

2.4  Summary 

A  recurrent  neural  networic  has  two  key  advantages  over  the  radar  target 
identification  algorithms  used  in  the  past.  First,  the  memory  storage  capacity  (for  the 
number  of  targets  and  training  sequences)  is  not  aihitrarily  limited,  unlike  an  optical 
neural  network.  Second,  data  sequences  of  arbitrary  length  can  be  handled  by  the  same 
recurrent  neural  network  architecture,  unlike  a  backpropagadon  neural  network.  Since 
hidden  Markov  models  [DeWitt,  1992:(Zh  1,  1]  and  other  stochastic  estimation 
techniques  [Libby,  1992a:Ch  1,  11]  for  radar  target  idenddcadon  are  under  research 
here  at  AFTT,  this  thesis  focuses  on  recurrent  neural  networks. 
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III.  Methodology 


3.1  Introduction 

Radar  target  identification  using  recurrent  neural  networks  was  performed  in 
three  steps.  Hrst,  the  RCS_TCX)LBOX  computer  program  generated  a  database  of  high 
ran^  resolution  radar  signatures  [Bramley  and  otlwrs,  1991].  Second,  these  signatures 
were  processed  into  sequences  of  feature  values  for  use  during  recurrent  neural  network 
training  and  testing.  Third,  a  recurrent  neural  network  computer  program 
(implementing  a  real  time  recurrent  learning  algorithm)  was  trained  to  recognize 
sequences  of  radar  signatures  from  five  different  aircraft  classes  [Lindsey,  1991:58- 
74].  Radar  target  identification  accuracy  was  verified  against  an  independent  set  of 
RCS.TOOLBOX  test  sequences. 

3.2  Radar  Signature  Generation 

The  RCS_T(X)LBOX  computer  program  is  actually  a  collection  of  over  a  dozen 
separate  programs.  Three  of  these  programs  are  required  to  generate  high  range 
resolution  radar  signatures  of  aircraft:  SCAMP,  SETUPPTD,  and  PTDTABLE.  These 
programs,  in  software,  put  an  aircraft  model  on  a  turntable  in  a  radar  test  range 
[Bramley,  1991  :Ch  2, 1-8].  This  is  the  same  experimental  setup  as  for  a  real  radar  test 
range. 


3.2.1  Aircrttft  Models.  SCAMP  creates  a  con  :puter  file  to  represent  the  diree 
diinrasional  geometry  of  an  aircraft  (Figure  3-1)  [Bramley,  1991  :Ch  3,  1-8].  Aircraft 
models  of  a  MiG-21  and  F-4  were  created  and  verified  here  at  AFTT  [Libby,  1992b]. 
Aircraft  models  of  an  F-15,  F-16,  and  F-18  came  with  the  RCS_T(X)LBOX  package. 
These  last  three  models  have  not  been  verified,  but  they  can  be  used  to  produce 
deterministic  radar  signatures.  None  of  the  five  SCAMP  models  were  validated  against 
real  radar  signatures. 
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Figure  3-1:  SCAMP  Models  of  a  MiG.21,  F-4,  F-15,  F-16,  and  F-18 


3.2.2  Radar  and  Geometry  Parameters.  SETUPPTD  defines  the  operating 
conditions  under  which  wideband  radar  signatures  are  generated  [Bramley,  1991:Ch  8, 
1-7].  The  radar  sensor  is  defined  by  setting  polarization,  frequency,  bandwidth,  range 
resolution,  and  range  extent  parameters.  The  aircraft  orientation  relative  to  the  radar  is 
controlled  by  defming  various  turntable  motion  parameters.  The  aircraft  is  placed  on 
the  turntable  at  defined  roll  and  pitch  angles.  The  tiuntable  itself  may  be  rotated  and 
tilted  as  required.  In  effect,  these  orientation  parameters  define  the  aircraft  aspect 
angles.  The  coordinate  transformation  between  the  orientation  parameters  and  aspect 
angles  can  be  simplified  by  setting  the  roll  and  pitch  angles  to  zero.  This  allows  the  dlt 
angle  to  control  elevation  and  turntable  rotation  to  control  azimuth.  Once  the  initial 
aircraft  orientation  is  fixed,  the  turntable  may  be  rotated  through  a  series  of  discrete 
angular  steps.  This  allows  PTDTABLE  to  generate  multiple  radar  signatures  as  the 
aspect  angles  change. 

3.2.3  Radar  Signature  Estimation.  PTDTABLE  uses  information  contained  in 
the  SCAMP  and  SETUPPTD  files  to  generate  high  range  resolution  radar  signatures 
[Bramley,  1991:Ch  9,  1-3].  This  program  uses  the  physical  theory  of  diffraction  to 
estimate  signatures  and  assumes  that  the  aircraft  dimensions  are  large  compared  to  the 
radar  wavelength.  PTDTABLE  estimates  radar  signatures  (for  a  specific  SCAMP 
nKxlel)  at  a  number  of  discrete  aspect  angles  (as  defined  in  the  SETUPPTD  file).  For 
this  thesis,  wideband  radar  signatures  were  generated  in  the  time  domain  for  the 
following  conditions: 

-  10  GHz  radar  center  frequency 

-  1  GHz  bandwidth 

-  O.IS  meter  range  resolution  (defined  by  the  bandwidth  [Mensa,  1991:9]) 

-  30  meter  range  extent  (producing  200  range  bins,  each  0. 15  meters  across) 

-  5  aircraft  classes:  MiG-21,F-4,  F-15,F-16,  andF-18 

-  Primary  aspect  angles:  -S**  to  -fS**  elevation  in  1**  steps,  with  1**  azimuth 
granularity  from  O'*  to  180°  (for  training  data) 
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-  Offset  aspect  angles:  -4.5®  to  44.5®  elevation  in  1®  steps  and  also  at  0® 
elevation,  with  1®  azimuth  granularity  from  0.5®  to  179.5®  (for  independent  test  data) 

-  Polarization  diverse  radar  signatures:  amplitudes  measured  at  LV  and  LH 
polarizations  (left  circular  transmit,  vertical  and  horizontal  receive) 

Each  radar  signature  took  about  5  seconds  to  compute  on  a  Silicon  Graphics  4D 
workstation.  Hgure  3-2  shows  part  of  an  RCS_TOOLBOX  file.  Rgure  3-3  plots  the 
resulting  radar  signature. 
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Figure  3-2:  Example  portion  of  an  RCS.TOOLBOX  data  file,  showing  the  LV 
polarization  data  for  a  MiG-21  at  0®  elevation,  0®  azimuth.  The  array  of 
numbers  contains  the  amplitude  and  phase  values  for  each  range  bin 
[Bramley,  1991:Ch  9,  1-3].  The  amplitude  and  phase  values  are 
transformed  for  integer  representation  [Bramley,  1991:Gi  A,  13]. 
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Hgure  3-3:  Example  of  a  polarization  diverse  radar  signature,  showing  the  LV  and 
LH  polarization  responses  of  a  MiG-21  at  O'*  elevation.  O'*  azimuth 
[Bramley  and  others,  1991:Ch  A,  11-14].  The  line  at  -30  dBsm  shows 
the  thermal  noise  threshold. 

3.3  Feature  Extraction 

This  section  describes  the  FORMAT.RCST  data  processing  computer  program. 
F(V  the  program  source  code,  see  Appendix  B.  FORMAT_RCST  reads  in  the  raw 
RCS.TOOLBOX  signature  data  files  and  performs  a  number  of  operations.  Each  of 
these  operations  is  described  in  turn: 

-  Select  a  starting  aspect  angle  for  a  sequence  of  radar  signatmes. 

-  Produce  an  azimuth  estimate  by  adding  noise  to  the  true  azimuth  value. 

-  Add  scintillation  noise  to  each  of  the  amplitude  values  in  a  signature. 

-  Apply  a  lower  threshold  limit  to  all  amplitude  values. 

-  Locate  the  target  within  the  range  extent  and  estimate  target  width. 

-  Divide  the  target  into  range  bin  intervals  and  downsample  to  a  fixed  number  of 
peak  range  bins. 

-  Statistically  normalize  feature  values  to  improve  neural  netwofic  training. 

3.3.1  Aspect  Angle  Sequences.  For  training  data  files,  the  sequence  starting 
aspect  angles  were  randomly  generated  (selected  one  at  a  time  without  replacement). 
This  improved  the  chances  that  the  recurrent  neural  network  algorithm  would  converge 
to  a  global  minimum  mean  squared  error  solution  instead  of  a  local  minimum.  Multiple 
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data  files  were  used  for  training  and  the  resulting  test  accuracies  were  compared. 
Training  data  files  were  generated  only  from  the  primary  aspect  angles.  Test  data  files 
were  generated  only  from  the  offset  aspect  angles  (ref:  Section  3.2.3). 

For  all  data  files,  sequences  were  generated  by  varying  only  the  aircraft 
azimuth.  Elevation  was  constant  for  any  one  sequence,  but  could  vary  between 
sequences.  Within  each  sequence,  the  azimuth  (truth)  angle  increased  by  1**  per  time 
step  for  a  total  of  10  time  steps  (1(F).  Reverse  direction  (decreasing  azimuth) 
sequences  were  not  included.  The  10^  sequence  length  was  chosen  to  be  the  upper  limit 
for  data  analysis  in  this  thesis.  A  recurrent  net  outputs  the  estimated  target  identity  at 
each  time  step  in  a  sequence  [Williams  and  Zipser,  1989:271],  so  the  10**  limit  allowed 
all  sequences  shorter  than  10^  to  be  analyzed  automatically. 

3.3.2  Azimuth  Estimates.  The  aspect  angle  ofrset  (bias)  was  generated  using  a 
Gaussian  distribution  with  a  standard  deviation  of  2  degrees.  Aspect  angle  random 
deviations  were  generated  using  a  Gaussian  distribution  with  a  standard  deviation  of  0.2 
degrees.  Random  numbers  from  both  distributions  were  limited  to  ±  3  standard 
deviations.  These  values  caused  an  azimuth  uncertainty  slightly  larger  than  the  ±  5** 
accuracy  quoted  for  typical  radar  tracking  algorithms  [Libby,  1992b].  Azimuth 
estimates  were  computed  each  time  a  signature  was  placed  in  a  sequence. 

3.3.3  Scintillation.  RCS.TOOLBOX  computed  noise-free  amplitude  values 
for  all  radar  signatures.  For  this  thesis,  scintillation  was  the  only  source  of  radar  system 
noise.  Noise  was  added  by  taking  an  RCSJTOOLBOX  amplitude  value,  adding  to  it  a 
random  number  (Gaussian  distribution  with  a  given  standard  deviation),  and  using  the 
result  as  a  representation  for  a  range  bin  amplitude  measurement  in  a  noisy  radar 
signature.  Noise  contributions  were  limited  to  ±3  standard  deviations:  this  prevented 
the  very  low  probability  extremes  of  the  Gaussian  distribution  from  affecting  the  data 
sets  [Libby,  1992b].  Noise  was  added  to  each  amplitude  in  the  raw  RCS_T(X)LBOX 
signatures  before  thresholding  (ref:  Section  3.3.4).  Note:  this  procedure  does  not 
exactly  model  scintillation  noise  as  it  affects  real  radar  systems.  However,  it  is 
sufficieiU  to  produce  random  amplitude  variations  that  are  similar  to  actual  scintillation 
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effects  [Sacchini,  1992b].  This  procedure  was  intended  to  simulate  only  scintillation 
noise  effects  above  the  threshold  limit  (Figure  3-4). 

The  standard  deviation  for  amplitude  noise  was  5  dBsm.  This  value  was  chosen 
to  simulate  the  effects  of  typical  radar  system  noise  [Libby,  1992b].  Noise  effects  were 
computed  each  time  a  signature  was  placed  into  a  sequence:  a  given  (truth)  aspect 
angle  was  represented  by  multiple  radar  signatures,  each  with  its  own  noise  realizations. 

3.3.4  Amplitude  Thresholding.  Each  RCS_T(X)LBOX  signature  contained 
200  range  bins  (with  200  LV  and  200  LH  amplitudes  making  up  the  polarization 
diverse  radar  signature).  This  was  too  much  information  for  a  recurrent  neural  network 
to  process  efficiently  (using  the  computer  resources  available  at  AFIT),  so  some  sort  of 
amplitude  feature  extraction  was  required.  This  thesis  used  a  combination  of  amplitude 
thresholding,  windowing,  and  downsampling.  Thresholding  was  chosen  because 
information  in  a  radar  signature  is  contained  in  the  high  amplitude  peaks,  not  the  low 
amplitude  nulls  [Sacchini,  1992:125].  Therefore,  all  amplitude  values  were  compared 
against  a  -30  dBsm  lower  threshold  value  (Figure  3-4).  For  this  thesis,  it  was  assumed 
that  all  thermal  noise  effects  were  eliminated  by  the  same  amplitude  threshold.  The 
windowing  and  downsampling  routines  are  described  in  the  following  sections. 

3.3.5  Range  Bin  Windowing.  The  amplitude  threshold  was  also  used  to  locate 
the  aircraft  within  the  2(X)  range  bins  (the  range  extent).  Starting  from  the  front  of  the 
range  extent,  the  range  bin  amplitude  values  were  searched  for  the  first  non-threshold 
value:  this  point  marked  the  ftx)nt  of  the  aircraft’s  radar  signature.  The  same  process 
was  used  to  find  the  back  of  the  signature.  The  range  extent  was  then  windowed  to 
include  only  those  range  bins  between  the  front  and  back  of  the  aircraft  signature 
(Figure  3-4).  The  target  window  size  varied  from  about  10  to  200  range  bins, 
depending  on  the  aircraft  and  aspect  angles.  Since  each  range  bin  measured  0.15 
meters  across  the  aircraft,  the  target  window  size  corresponded  to  the  aircraft  width  as 
seen  by  the  radar.  The  target  window  size  (in  range  bins)  was  used  as  a  feature  value. 
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Rguie  3-4:  Example  of  the  FORMAT_KCST  feature  extraction  process  for  a  single 

signature.  This  signature  is  from  a  MiG-21  at  0^  elevation,  0**  azimuth. 
Note  the  small  peak  in  range  bin  142:  scintillation  noise  makes  it  visiUe 
above  die  thermal  noise  threshold. 
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3.3.6  Amplitude  Downsampling.  A  recurrent  neural  network  must  have  a 
fixed  number  of  input  feature  values  to  describe  each  signature.  Since  the  number  of 
range  bins  in  the  target  window  was  variable,  a  feature  extraction  routine  was  needed  to 
select  a  fixed  number  of  range  bins  for  all  signatures.  This  thesis  used  a  peak  extraction 
routine.  Each  range  window  was  divided  into  a  fixed  number  m  intervals,  with  each 
interval  being  n  range  bins  wide:  n  was  constant  for  all  intervals  within  the  same 
signature,  but  varied  between  signatures.  Within  each  interval,  a  max  out  of  n 
downsampling  routine  selected  the  range  bin  with  the  highest  LV  and  LH  amplitude 
sum.  These  peak  LV  and  LH  amplitude  values  (from  the  same  range  bin)  became 
feature  values  for  that  interval  and  were  used  as  inputs  to  the  recurrent  neural  network 
(Hgure  3-4).  For  this  thesis,  the  phrase  "peak  range  bin"  refers  to  the  paired  LV  and 
LH  amplitude  values  selected  by  this  downsampling  routine. 

Amplitude  downsampling  was  perfoniKd  independently  on  each  radar  signature 
as  it  was  placed  into  a  sequence.  The  location  of  the  peak  range  bins  varied  between 
signatures,  but  peak  location  was  not  used  as  an  input  feature  value.  For  some  radar 
signatures,  m  was  larger  than  the  number  of  range  bins  in  the  target  window.  When 
this  luq>pened,  all  of  the  available  range  bins  were  used  directly  as  peak  range  bins. 
The  extra  feature  values  were  then  padded  with  noise  threshold  amplitude  values. 

3.3.7  Data  Normalization.  All  of  the  feature  values  were  statistically 
normalized  before  being  written  to  an  output  data  file.  This  allowed  the  recurrent 
neural  network  to  properly  learn  the  input  data  sets.  Statistical  data  were  calculated 
from  the  set  of  raw  RCS.TOOLBOX  signMures,  before  any  noise  effects  were  added. 
A  mean  and  standard  deviation  were  calculated  separately  for  the  azimuth,  the  target 
width  (based  on  amplitude  thresholding),  and  the  amplitude  values.  For  the  amplitude 
statistics,  all  of  the  LV  and  LH  amplitude  values  were  considered  together.  Any 
aiqrlitude  less  than  or  equal  to  the  amplitude  threshold  limit  was  ignored: 
FORMAT_RCST  computed  the  amplitude  mean  and  standard  deviation  based  only  on 
the  data  points  above  the  amplitude  threshold. 
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3.4  Decision  Processing:  Recurrent  Neural  Networks 

This  section  describes  the  RECURRENT  computer  program,  which  uses  a  real 
tune  recurrent  learning  (gradient  descent)  algorithm  for  radar  target  identification.  For 
a  diagram  of  a  recurrent  neural  network,  see  Hgure  3-5.  The  real  time  recurrent 
learning  algorithm  itself  is  described  completely  in  the  literature  [Lindsey,  1991:12- 
17][Williams  and  Zipser,  1989:270-280].  I^vious  woik  at  AFTT  had  already 
iiiq)lemented  the  algorithm  as  the  computer  program,  RECNET  [Lindsey,  1991:12-17]. 
However,  certain  modifications  were  required  to  properly  handle  the  radar  target 
identification  problem.  For  the  RECURRENT  source  code  listing,  see  Appendix  C. 

3.4.1  Modifications.  The  most  important  change  called  for  breaking  the 
training  loop  over  all  input  vectors  (in  RECNET)  into  two  loops:  one  for  sequences 
and  the  other  for  signatures  within  a  sequence.  At  the  beginrung  of  each  sequence,  the 
ouqrut  values,  the  output  derivatives,  and  the  partial  derivatives  matrix  (P)  were  all  set 
to  zero.  The  program  was  also  changed  to  allow  for  batch  mode  learning  after  the 
(Mesentation  of  each  signature,  sequence,  or  epoch.  For  this  thesis,  batch  nnode 
learning  was  done  after  each  sequence.  Hnally,  the  hyperbolic  tangent  was  used  as  the 
mm-linearity  squashing  function  instead  of  the  standard  sigmoid. 

3.4.2  Output  Classification.  A  recurrent  neural  network  can  only  process 
sequences  of  data  [Williams  and  Zipser,  1989:270-280].  For  any  given  signature,  there 
will  always  be  a  time  delay  between  presenting  a  signature  to  the  net  and  recording  the 
output  node  classification  values  affected  by  that  signature.  For  this  thesis,  the  time 
delay  was  one  time  step:  the  minimum  sequence  length  was  two  signatures. 

In  RECURRENT,  additional  subroutines  were  written  to  compute  classification 
accuracies  at  each  time  step  during  a  sequence.  These  subroutines  checked  to  see  if  the 
ouq>ut  node  values  were  "right"  or  "good".  If  all  of  the  actual  output  node  values  were 
within  20%  of  the  desired  values,  then  the  neural  network  classified  the  sequence  (at 
that  time  step)  as  "right".  For  the  hyperbolic  tangent,  desired  outputs  were  +1.0  for  the 
collect  class  and  -1.0  for  all  other  classes.  If  the  output  node  with  the  highest  actual 
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ouQ>ut  (through  a  max  pick  routine)  corresponded  to  the  desired  output  node  class,  then 
the  neural  network  classified  the  sequence  (at  that  time  step)  as  "good".  Note:  all 
outputs  that  are  "right"  are  also  "good",  but  not  vice  versa.  Output  node  values  and 
their  classification  categories  were  recorded  for  each  time  step:  these  formed  the  basis 
for  the  epoch  accuracy  and  sequence  length  statistics. 

3.4.3  Epoch  Accuracy.  Errors  measured  over  an  entire  epoch  (training  or 
testing)  were  expressed  using  the  mean  squared  error  per  output  node.  This  was  done 
by  measuring  the  cumulative  difference  between  the  desired  and  actual  output  values 
over  all  output  nodes  and  signatures  in  an  epoch,  then  dividing  by  the  total  number  of 
output  nodes  and  signatures.  The  real  time  recurrent  learning  algorithm  seeks  to 
minimize  the  mean  squared  error  between  the  desired  and  actual  output  node  values  by 
using  gradient  descent.  The  gradient  descent  process  does  this  by  adjusting  the 
interconnection  weight  values  between  the  input  and  output  layer  nodes  [Williams  and 
Zipser,  1989:270-280]. 

The  mean  squared  error  was  also  used  by  RECURRENT  to  modify  the  learning 
rate  (alpha)  during  training.  After  the  first  five  tnuning  epochs,  the  learning  rate  was 
cut  in  half  if  error  increased  by  more  than  1%.  This  is  based  on  the  RECNET  variable 
learning  rate  algorithm  [Lindsey,  1991:16-17]. 

3.4.4  Sequence  Length  Analysis.  For  this  thesis,  the  recurrent  neural  networir 
classified  a  target  at  each  time  step  in  a  sequence  except  the  first.  This  capability  was 
used  to  help  find  the  optimum  sequence  length  for  radar  target  identification  under 
specific  test  conditions.  If  the  classification  accuracy  at  a  given  time  step  f  +  1  (which 
is  computed  after  t  input  signatures  have  been  processed)  is  summed  over  all  test 
sequences,  then  the  resulting  statistic  is  the  accuracy  of  the  network  if  all  of  the  test 
sequences  contained  exactly  t  signatures.  This  assumes  that  each  sequence  is 
classified  only  by  the  output  node  values  at  the  end  of  the  sequence.  If  this  summation 
is  ccMnpttted  for  each  time  step  starting  at  r  s  2  signatures,  then  the  number  of 
signatures  required  to  produce  unique  sequences  can  be  found  (ref:  Section  1.1.7). 
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3.5  Test  Cases 

The  recurrent  neural  netwoiic  algorithm  was  tested  for  radar  target  identification 
performance  in  three  steps.  All  of  the  topics  discussed  in  Sections  3.2  and  3.3  were 
applied,  with  specific  modifications  as  listed  under  each  test  case. 

3.5.1  Case  One:  Two  Aircraft,  No  Noise.  This  test  case  was  investigated  to 
IMTOve  the  feasibility  of  using  recurrent  neural  networks  for  radar  target  identification.  It 
was  chosen  for  conceptual  simplicity  and  computational  speed.  The  following 
conditions  were  used: 

-  2  aircraft  classes:  MiG-21  (class  1),  F-4  (class  2) 

-  0**  elevation 

-  0"  to  180°  azimuth 

-  Perfect  knowledge  of  aircraft  azimuth 

-  No  scintillation  noise 

3.5.2  Case  Two:  Five  Aircraft,  No  Noise.  This  test  case  was  investigated  to 
find  a  suitably  confused  region  in  the  radar  signature  feature  space.  It  was  chosen  so 
the  advantages  of  sequence  analysis  could  be  clearly  demonstrated.  The  following 
ccmditions  were  used: 

-  5  aircraft  classes:  MiG-21  (class  1),  F-4  (class  2),  F-IS  (class  3),  F-16  (class  4), 
F-18  (class  5) 

-  0°  elevation 

-  0°  to  180°  azimuth  in  30°  sectors:  train  six  separate  nets,  one  for  each  sector. 

-  Perfect  knowledge  of  aircraft  azimudi 

-  No  scintillation  noise 

-  A  minimum  number  of  input  feature  to  describe  each  radar  signature. 
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3.5.3  Case  Three:  Five  Aircraft,  With  Noise.  This  test  case  was  investigated 
to  demonstrate  that  recurrent  neural  networks  can  be  used  for  radar  target  identification 
under  realistic  operational  conditions.  The  following  conditions  were  used: 

-  S  aircraft  classes:  MiG-21  (class  1),  F-4  (class  2),  F-IS  (class  3),  F-16  (class  4), 
F-18  (class  5) 

-  +5®  to -5*  elevation 

-  60®  to  90®  azimuth  (a  sector  from  Case  Two) 

-  Azimuth  uncertainty  included 

-  Scintillation  noise  included 

3.6  Summary 

This  chapter  described  a  methodology  to:  (1)  generate  high  range  resolution 
radar  signatures,  (2)  process  these  signatures  into  sequences  for  recurrent  neural 
network  training,  and  (3)  train  and  test  a  recurrent  neural  network  for  radar  target 
identification.  The  test  case  results  are  given  in  Chapter  IV. 
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IV.  Results 


4.1  Introduction 

This  chapter  contains  results  from  the  three  radar  target  identification  test  cases 
described  in  Section  3.5.  For  all  test  cases,  training  and  test  data  files  were  generated 
from  different  aspect  angles  (within  the  same  region).  The  recurrent  neural  net  was 
able  to  generalize  from  discrete  training  data  at  1**  aspect  angle  granularity.  However, 
recall  that  within  any  given  sequence,  elevation  was  constant  and  azimuth  increased  by 
1**  per  time  step. 

Case  One  considered  two  aircraft  classes,  a  single  elevation,  and  no  noise.  This 
test  case  was  investigated  to  show  that  a  recurrent  neural  network  can  process 
sequences  of  radar  signatures  and  identify  aircraft  classes.  Each  radar  signature  wa« 
desaibed  by  22  external  input  features;  the  azimuth,  target  width,  and  20  amplitude 
values  from  10  peak  range  bins.  Four  consecutive  radar  signatures  were  sufficient  to 
reach  a  test  set  accuracy  of  99%  "right"  and  99%  "good"  (ref:  Section  3.4.2). 

Case  Two  considered  five  aircraft  classes,  a  single  elevation,  and  no  noise.  In 
this  test  case,  the  recurrent  net  was  deliberately  given  minimal  information  about  each 
radar  signature.  Over  most  of  the  aircraft  aspect  angles,  radar  signatures  were  described 
by  4  external  input  features:  the  azimuth,  target  width,  and  2  amplitude  values  from  a 
single  peak  range  bin.  Nine  consecutive  radar  signatures  were  sufficient  to  reach  a  test 
set  accuracy  of  84%  to  99%  right  and  99%  "good”.  One  aspect  angle  region  was  more 
difficult  for  target  recognition  (Sector  3,  from  60*^  to  azimuth),  where  each  radar 
signature  had  to  be  described  by  6  input  features:  the  azimuth,  target  width,  and  4 
anq;>litude  values  from  2  peak  range  bins.  For  these  aspect  angles,  5  consecutive  radar 
signatures  were  sufficient  to  teach  a  test  set  accuracy  of  99%  "right"  and  99%  "good". 

Case  Three  considered  five  aircraft  classes,  a  ±  5**  elevation  range,  and  noise. 
Each  radar  signature  was  described  by  6  external  input  features:  the  estimated  target 
azimuth,  estimated  target  width,  and  4  noisy  amplitude  values  from  2  peak  range  bins. 
Elevation  was  not  used  as  an  input  feature.  Nine  consecutive  radar  signatures  were 
sufficient  to  achieve  a  test  set  accuracy  of  91%  "right”  and  96%  "good". 
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4.2  Case  One:  Two  Aircraft,  No  Noise. 

This  test  case  proves  the  feasibility  of  using  recurrent  neural  netwoiics  for  radar 
target  identification.  It  was  chosen  for  conceptual  simplicity  and  computational  speed. 
It  is  also  similar  to  the  experiment  conducted  by  Farhat  [Farhat,  1989:670-680].  The 
following  recurrent  neural  network  configuration  was  used: 

-  1  bias  input 

-  1  external  input  (at  time  t)  for  azimuth 

-  1  external  input  (at  time  /)  for  target  width  (ref:  Section  3.3.S) 

-  20  external  inputs  (at  time  t)  for  radar  amplitude  values,  containing  the  LV  and 

LH  amplitudes  for  10  peak  range  bins  from  each  signature  (ref:  Section  3.3.6) 

-  2  output  nodes  (at  time  /  +  1):  MiG-21  (class  1),  F-4  (class  2) 

-  no  hidden  nodes 

There  were  a  total  of  SO  adjustable  weights  in  the  weight  matrix.  Three  sets  of 
data  files  were  used  to  train  and  test  the  network.  Training  data  files  contained 
signatures  from  0**  elevation  at  the  integer  azimuths  from  0**  to  180^  (ref:  the  primary 
aspect  angles  from  Section  3.2.3).  Each  training  file  had  a  total  of  344  sequences 
(representing  all  possible  10"  sequences  from  0"  to  180"  azimuth  at  a  single  elevation). 
Test  data  files  contained  signatures  from  0"  elevation  at  the  half  angle  azimuths  fix>m 
0.5"  to  179.5"  (ref:  the  offset  aspect  angles  from  Section  3.2.3).  Each  test  file  had  a 
total  of 342  sequences. 

The  network  was  trained  for  100  epochs  using  an  initial  learning  rate  of  0.01. 
During  training,  the  learning  rate  generally  decreased  to  0.(X)5  (ref:  Section  3.4.3). 
After  training,  the  mean  squared  error  per  output  node  (versus  the  independent  test  sets) 
was  approximately  0.02.  For  test  set  accuracy,  the  net  achieved  92%  "right"  and  98% 
"good"  after  2  signatures  and  99%+  "right"  and  "good"  after  about  4  signatures.  This 
means  the  MiG-21  and  F-4  can  be  identified  under  the  Case  One  conditions,  where  each 
radar  signature  is  represented  by  22  external  input  features.  Radar  signatures  must  be 
measured  ov»  4"  of  azimuth  to  identify  the  aircraft  classes. 
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These  results  are  easy  to  explain:  target  regions  within  the  signature  feature 
space  were  easily  distinguished.  Kgure  4-1  shows  a  plot  of  target  width  as  a  function 
of  azimuth  angle.  Figure  4-1  clearly  shows  distinct  regions  for  each  target  class,  even 
without  extra  information  from  the  radar  signature  amplitudes.  The  azimuth  and  target 
width  features  alone  should  be  rnfficient  to  identify  the  target  classes.  In  this  feature 
space,  almost  any  decision  processing  algorithm  will  achieve  excellent  results.  The 
recurrent  neural  network  was  able  to  process  temporal  sequences  of  radar  signatures 
and  identify  targets  for  the  Case  One  conditions.  This  demonstrated  the  feasibility  of 
using  recurrent  neural  networks  for  radar  target  identification. 


Figure  4-1:  Azimuth  versus  target  width  for  the  Case  One  feature  space.  As  the 
aircraft  azimuth  varies,  the  radar  measures  difrerent  target  widths.  These 
two  features  separate  the  MiG-21  and  F-4  classes,  except  for  a  small 
region  near  170°  azimuth.  The  overall  (sinusoidal)  shapes  are  due  to 
physical  geometry:  both  aircraft  are  longer  than  they  are  wide.  The 
discontinuities  are  due  to  low  amplitude  peaks  alternately  appearing  and 
disappearing  near  the  -30  dBsm  thermal  noise  threshold. 

4.3  Case  Two:  Five  Aircraft,  No  Noise. 

This  test  case  demonstrates  the  advantages  of  using  a  sequence  feature  space  for 
decision  processing.  For  this  problem,  the  number  of  external  input  features  describing 
each  radar  signature  was  deliberately  reduced.  This  was  done  to  force  target  regions  in 
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the  signature  feature  space  to  overlap.  The  recurrent  net  was  able  to  process  this 
reduced  amount  of  data  as  sequences  and  still  identify  the  aircraft  classes. 

The  0**to  180**  azimuth  range  was  arbitrarily  divided  into  six  sectors.  This  was 
done  to  speed  up  network  training  (with  smaller  data  files)  and  to  find  the  azimuth 
region  that  was  the  most  difficult  for  radar  target  identification.  The  sectors  were 
numbered  from  1  to  6  with  sector  1  ranging  from  O'*  to  30**  azimuth.  Each  sector  was 
used  to  train  separate  networks.  Case  Two  results  are  presented  in  two  parts.  The  first 
part  deals  with  sectors  1,  2,  4,  S,  and  6:  these  sectors  all  had  similar  results.  The 
second  part  deals  with  sector  3  (between  60°  and  90°  azimuth):  sequences  in  this 
region  were  more  difficult  to  classify.  Sector  3  was  the  most  difficult  to  solve  under 
C!ase  Two  conditions,  so  it  was  analyzed  further  in  Case  Three. 

4.3.1  Case  Two:  Sectors  1,  2,  4, 5,  and  6 

The  following  recurrent  neural  network  configurations  were  used: 

-  1  bias  input 

-  1  external  input  (at  time  t)  for  azimuth 

-  1  external  input  (at  time  t)  for  target  width  (ref:  Section  3.3.5) 

-  2  external  inputs  (at  time  t)  for  radar  amplitude  values,  containing  the  LV  and 
LH  amplitudes  for  a  single  peak  range  bin  fix)m  each  signature  (ref:  Section 
3.3.6) 

-  5  output  nodes  (at  time  t  +  1):  MiG-21  (class  1),  F-4  (class  2),  F-15  (class  3), 
F-16  (class  4),  F-18  (class  5) 

-  no  hidden  nodes  for  sectors  1, 2, 5,  and  6:  50  adjustable  weights  in  these  weight 
matrices 

-  3  hidden  nodes  for  sector  4:  104  adjustable  weights  in  this  weight  matrix 

For  each  sector,  two  sets  of  data  files  were  used  to  train  and  test  the  netwrnk. 
Training  data  files  contained  signatures  from  0°  elevation  at  the  integer  azimuths  (ref: 
the  primary  aspect  angles  from  Section  3.2.3).  Each  training  file  had  a  total  of  110 
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Test  Aocufacy  ("Right”) 


sequences  (representing  all  possible  10°  sequences  from  a  30°  azimuth  region,  single 
elevation,  five  targets).  Test  data  files  contained  signatures  from  0°  elevation  at  the  half 
angle  azimuths  (ref:  the  offset  aspect  angles  from  Section  3.2.3).  Each  test  file  had  a 
total  of  105  sequences. 

Sectors  1, 2,  S,  and  6  were  trained  for  1(X)  epochs  using  an  initial  learning  rate 
of  0.001.  During  training,  the  learning  rate  generally  decreased  to  0.0025.  After 
training,  the  mean  squared  error  per  output  node  (versus  the  independent  test  sets) 
varied  from  about  0.1  to  0.35.  Sector  4  was  a  bit  more  difficult  to  train,  requiring  500 
epochs.  During  training,  the  sector  4  learning  rate  generally  decreased  to  0.00125. 
After  training,  the  sector  4  means  squared  error  per  output  node  was  about  0.35.  Figure 
4-2  shows  the  recognition  accuracy  plots  against  test  data  sets  for  sector  one.  Sectors  2, 
4, 5,  and  6  had  similar  accuracy  plots. 


Figure  4-2:  Plots  of  sequence  length  versus  test  set  recognition  accuracy  for  Case 
Two,  sector  one.  Results  are  given  from  three  separate  weight  matrices 
(hence  the  three  curves  on  each  plot)  created  by  training  the  recurrent  net 
three  times.  Each  weight  matrix  was  tested  for  accuracy  using  both  the 
"right"  and  "good"  criteria.  As  the  number  of  signatures  in  a  sequence 
increases,  the  sequences  becomes  more  and  more  unique. 

The  recognition  accuracies  shown  in  Hgure  4-2  are  based  on  classifying  a 
sequence  using  only  the  outputs  from  the  last  signature  in  the  sequence.  Since  each 
successive  output  value  is  dependent  on  all  previous  values,  these  plots  measure  the 
inftumation  content  in  a  given  sequence  length.  For  a  two  signature  sequence,  the  test 
set  classification  accuracies  are  about  10%  tight  and  70%  good.  As  the  sequence  length 
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Test  Accuracy  ("Right”) 


increases,  recognition  accuracy  also  increases.  For  sectors  1,  2,  4,  S,  and  6,  the 
recurrent  neural  network  achieves  a  test  set  accuracy  of  84%  to  99%  "right"  and  99%+ 
"good"  accuracy  after  about  9  signatures.  This  means  the  five  aircraft  classes  can  be 
identified  (for  most  aspect  angles)  under  the  (Tase  Two  conditions,  where  each  radar 
signature  is  represented  by  4  external  input  features.  Radar  signatures  must  be 
measured  over  9^  of  azimuth  to  identify  the  aircraft  classes. 

4.3.2  Case  Two:  Sectors 

The  recurrent  neural  networic  configuration  was  the  same  as  for  sectors  1,  2,  5, 
and  6,  except  that  an  additional  2  external  inputs  were  used  for  radar  amplitude  values 
(using  two  peak  range  bins  rather  than  just  one).  Recall  that  only  the  peak  amplitude 
values  were  used  as  input  features..  The  locations  of  these  peaks  within  the  radar 
signatures  were  not  fed  into  the  net  (ref:  Section  3.3.6).  There  were  no  hidden  nodes, 
so  the  weight  matrix  contained  a  total  of  60  adjustable  weights.  Training  and  test  data 
files  were  generated  using  the  same  procedures  as  for  the  other  sectors. 

The  network  was  trained  for  500  epochs  using  an  initial  learning  rate  of  0.001. 
During  training,  the  learning  rate  generally  stayed  constant.  After  training,  the  mean 
squared  error  per  output  node  (versus  the  independent  test  sets)  was  approximately 
O.OSS.  Figure  4-3  shows  the  recognition  accuracy  plots  against  test  data  sets  for  sector 
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Figure  4-3:  Plots  of  sequence  length  versus  test  set  recognition  accuracy  for  Case 
Two,  sector  three.  These  plots  are  similar  to  those  in  Figure  4-2,  except 
the  results  are  based  on  6  external  input  features  to  describe  each  radv 
signature.  Six  feature  values  were  required  because  4  features  could 
provide  only  90%  "good"  accuracy. 
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three.  For  a  two  signature  sequence,  the  test  set  classification  accuracies  are  about  33% 
right  and  97%  good.  The  recurrent  neural  network  achieves  99%+  "right"  and  "good" 
accuracy  (versus  the  independent  test  sets)  after  about  5  signatures.  This  means  the  five 
aircraft  classes  can  be  identified  under  Case  Two  conditions,  where  each  radar  signature 
is  represented  by  6  external  input  features.  Radar  signatures  must  be  measured  over  S** 
of  azimuth  to  identify  the  aircraft  classes. 

4.3.3  Case  Two:  Summary.  This  test  case  demonstrated  the  advantages  of 
using  a  sequence  feature  space  for  decision  processing.  As  the  sequence  length 
increased,  recognition  accuracy  also  increased.  Since  sector  3  was  the  most  difficult  to 
solve  under  Case  Two  conditions,  it  was  analyzed  further  in  Case  Three. 

4.4  Case  Three:  Five  Aircraft,  With  Noise. 

This  test  case  was  investigated  to  demonstrate  that  recurrent  neural  networks 
can  be  used  for  radar  target  identiflcation  under  realistic  operational  conditions.  The 
following  conditions  were  used: 

-  1  bias  input 

-  1  external  input  (at  time  t)  for  the  estimated  azimuth  value  (bias  standard 
deviation  of  2^  and  random  fluctuations  standard  deviation  of  0.2**) 

■  1  external  input  (at  time  t)  for  the  estimated  target  width  (ref:  Section  3.3.5) 

•  A  variable  number  of  radar  amplitude  values,  starting  off  with  the  LV  and  LH 
amplitudes  from  a  single  peak  range  bin  (ref:  Section  3.3.6).  Additional 
amplitude  features  were  added  one  range  bin  at  a  time. 

-  scintillation  noise  (standard  deviation  of  5  dBsm)  added  to  the  amplitude  values 

-  5  output  nodes:  MiG-21  (class  1),  F-4  (class  2),  F-15  (class  3),  F-16  (class  4), 
F-18(class5) 

-  no  hidden  nodes 
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The  network  started  out  with  a  total  of  SO  adjustable  weights  in  the  weight 
matrix.  For  each  additional  peak  range  bin,  the  number  of  weights  increased  by  10. 
Data  sets  were  created  by  extending  sector  three  over  a  ±5**  elevation  range.  To 
adequately  represent  the  distribution  of  noisy  input  values,  each  sequence  was  placed  in 
the  data  files  twice.  Noise  effects  were  computed  each  time  a  signature  was  placed 
into  a  sequence,  so  aspect  angles  between  69**  and  81**  azimuth  were  represented  by  a 
total  of  20  independent  noise  realizations.  This  applied  to  training  and  test  data  files. 
Training  data  files  contained  signatures  from  the  primary  aspect  angles  (ref:  Section 
3.2.3).  Each  training  file  had  a  total  of  2420  sequences  (representing  all  possible  10** 
sequences  out  of  a  30**  azimuth  region,  11  elevations,  five  targets,  each  sequence  used 
twice).  Test  data  files  contained  signatures  fiom  the  half-angle  elevations  (ref:  the 
offset  aspect  angles  fiom  Section  3.2.3).  Each  test  file  had  a  total  of  2100  sequences. 

4.4.1  Case  Three:  One  Peak  Range  Bin.  The  network  was  trained  for  1(X) 
epochs  using  an  initial  learning  rate  of  0.0001.  During  training,  the  learning  rate 
generally  decreased  to  0.00005.  After  training,  the  mean  squared  error  per  output  node 
(versus  the  independent  test  sets)  was  approximately  0.65.  Plots  of  test  set  recognition 
accuracy  versus  sequence  length  are  shown  in  Figure  4-4.  Accuracy  teaches  a 
maximum  of  about  55%  right  (with  8  signatures)  and  about  76%  good  (with  7 
signatures).  These  results  mean  that  a  single  peak  range  bin  cannot  provide  enou^ 
information  to  produce  unique  signatures. 

4.4.2  Case  Three:  Two  Peak  Range  Bins.  The  network  was  trained  for  100 
epochs  using  an  initial  learning  rate  of  0.0(X)1.  During  training,  the  learning  rate 
generally  decreased  to  0.00(X)25.  After  training,  the  mean  squared  error  per  output 
node  (versus  the  independent  test  sets)  was  approximately  0.28.  Plots  of  recognition 
accuracy  versus  sequence  length  are  shown  in  Hgure  4-4.  Test  set  accuracy  reaches  a 
maximum  of  about  90%  right  (with  9  signatures)  and  about  96%  good  (with  8 
signatures).  These  results  are  remarkable,  considering  that  target  classifications  ate 
made  using  only  six  input  features  and  simple  vector*matrix  multiplications.  Two  peak 
range  bins  provided  almost  enough  information  to  produce  unique  signatures. 
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Figure  4^:  These  plots  show  the  effect  of  additional  input  feature  values  on  test  set 
accuracy  for  Case  Three.  The  top  pair  of  curves  use  4  input  features: 
the  azimuth  estimate,  the  target  width  estimate,  and  two  noisy  amplitude 
values  fimm  a  single  peak  range  bin.  The  bottom  pair  of  curves  use 
aii9>litudes  from  an  additional  peak  range  bin.  For  lx>th  sets  of  curves, 
test  set  accuracy  increases  as  longer  sequences  are  processed. 


4.5  Summary 

This  chapter  presented  results  from  three  separate  test  cases.  Case  (Xie 
demonstrated  the  feasibility  of  using  recurrent  neural  networks  for  radar  target 
identification.  Case  Two  showed  that  there  is  a  relationship  between  the  number  of 
signatures  in  a  sequence  and  the  test  set  accuracy.  If  enough  signatures  are  included  in 
a  sequence,  the  sequence  will  become  unique.  Case  Three  showed  that  a  reciment 
neural  netwt^  can  process  sequences  of  rroisy  data  and  still  achieve  very  high  test  set 
accuracies. 


4-9 


V.  Conclusions 


5.1  Introduction 

The  goal  of  this  thesis  was  to  identify  five  aircraft  classes  using  sequences  of 
high  range  resolution  radar  signatures.  Radar  target  identification  is  an  important  part 
of  the  aircraft  surveillance  mission.  Identification  was  performed  using  a  recurrent 
neiual  network,  which  implemented  a  real  time  recurrent  learning  algorithm.  Recurrent 
neural  networks  were  trained  and  tested  against  three  successively  more  difficult  radar 
target  identification  problems.  Ouq)ter  IV  contains  the  results  for  each  of  these  test 
cases. 


5.2  Conclusions 

The  first  test  case  (two  aircraft  classes,  (f  elevation,  no  noise)  demonstrated  the 
feasibility  of  using  recurrent  neural  networks  for  radar  target  identification.  Each  radar 
signature  was  described  by  22  external  input  features:  the  azimuth,  target  width,  and  20 
aiiq)litude  values  from  10  peak  range  bins.  Four  consecutive  radar  signatures  were 
sufficient  to  reach  a  test  set  accuracy  of  99%  "right"  and  99%  "good".  For  Case  One, 
target  regions  within  the  signature  feature  space  were  easily  distinguished. 

The  second  test  case  (five  aircraft  classes,  0**  elevation,  no  noise)  denx>nstrated 
the  advantages  of  using  sequence  analysis  to  identify  targets.  The  amount  of 
infcmnation  in  each  radar  signature  was  arbitrarily  reduced  in  an  attempt  to  force  the 
different  target  classes  into  the  same  regions  of  the  signature  feature  space.  For  most 
aspect  angles,  each  radar  signature  was  described  by  4  external  input  features;  the 
azimuth,  target  width,  and  2  amplitude  values  from  a  single  peak  range  bin.  Nine 
consecutive  radar  signatures  were  sufficient  to  reach  a  test  set  accuracy  of  84%  to  99% 
"right  "  and  99%  "good".  Sector  3  (60^  to  9(f  azimuth)  was  more  difficult  for  radar 
taig^  identification.  Each  radar  signature  in  sector  3  had  to  be  desoibed  by  6  ininit 
features:  the  azimuth,  target  width,  and  4  amplitude  values  from  2  peak  range  bins. 
Rve  consecutive  radar  signatures  were  sufficient  to  reach  a  test  set  accuracy  of  99% 
"riglrt"  and  99%  "good".  Case  Two  showed  that  recognition  accuracy  increases  as  the 
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sequence  length  increases.  For  cases  when  the  radar  signatures  are  not  unique, 
sequences  can  be  used  to  help  increase  recognition  accuracy. 

The  third  test  case  (Hve  aircraft  classes,  +5**  to  -5"  elevation  range,  with  noise) 
demonstrated  that  a  recurrent  neural  networic  can  identify  targets  under  realistic 
operational  conditions.  Each  radar  signature  was  described  by  6  external  input  features: 
the  estimated  target  azimuth,  the  estimated  target  width,  and  4  noisy  amplitude  values 
firom  2  peak  range  bins.  Nine  consecutive  radar  signatures  were  sufficient  to  achieve  a 
test  set  accuracy  of  91%  "right"  and  96%  "good". 

These  results  bring  up  several  interesting  conclusions: 

-  There  is  a  significant  amount  of  information  contained  in  the  temporal 
sequences  of  radar  signatures.  Sequence  processing  increases  target  recognition 
accuracy. 

-  Aspect  angle  and  target  width  estimates  make  good  features  for  radar  target 
identification.  For  simple  problems,  these  two  features  may  be  sufficient  to  identify  the 
target  classes.  When  noisy  radar  data  is  used,  these  features  can  be  processed  as 
sequences:  noisy  features  or  not,  they  contribute  to  recognition  accuracy. 

-  A  wideband  radar  with  a  sufficient  range  resolution  is  required  to  measure  the 
target  width.  Once  the  target  width  is  measured,  most  of  the  information  (amplitudes) 
in  a  high  range  resolution  radar  signature  may  be  downselected  and  thrown  out.  Only  a 
few  of  the  dominant  range  bins  need  to  be  retained  as  additional  feature  inputs. 

-  Fm*  this  thesis,  a  simple  peak  extraction  algorithm  was  sufficient  to  identify  the 
dominant  range  bins. 

-  As  the  radar  signatures  are  described  by  more  and  more  features,  recognition 
accuracy  increases.  This  means  there  is  a  badeoff  between  using  sequence  processing 
with  fewer  features  and  "single-look"  processing  with  more  features.  For  a  given  radar 
target  identification  problem,  these  two  tqiproaches  can  be  compared  to  find  the  optimal 
solution. 
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5.3  Recommendations  for  Future  Research 

Are  there  any  other  features  that  may  be  used  to  help  identify  radar  targets?  For 
exanq>le,  temporal  phase  variations  are  used  by  synthetic  and  inverse  synthetic  q)eiture 
mode  radar  to  produce  a  two-dimensional  unage  of  a  target.  These  phase  variations 
may  be  a  feature  value  that  can  be  used  for  aircraft  target  identification  as  well. 
Alternatively,  a  recurrent  neural  network  might  be  able  to  identify  ground  targets  by 
processing  sequences  of  synthetic  aperture  mode  radar  signatures. 

Can  a  recurrent  neural  network  recognize  the  radar  sequences  from  arbitrary 
aspect  angle  trajectories?  This  thesis  assumed  that  targets  followed  a  "turntable 
motion"  type  of  trajectory.  For  real  world  radar  applications,  this  type  of  motion  is  not 
often  seen:  there  is  an  infinite  number  of  potential  aspect  angle  sequences.  Can  a 
recurrent  network  be  trained  (with  a  finite  data  set)  to  recognize  an  infinite  number  of 
sequences? 

What  kind  of  performance  will  a  recurrent  neural  network  achieve  when  the 
targets  are  just  barely  detectable  above  the  thermal  noise  limit?  This  thesis  did  not 
address  thermal  noise  effects:  for  long  range  aircraft  surveillance  systems,  thermal 
noise  will  be  a  dominant  factor.  Can  a  recurrent  neural  network  be  used  to  locate 
and/w  identify  targets  that  are  right  at  the  detection  threshold? 
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Appendix  A.  Software  Development 


Appendix  B  contains  the  source  listing  for  FORMAT.RCST.  This  program 
reads  in  wideband  radar  signatures  (RCS.TOOLBOX  [Bramley  and  others,  1991:  A, 
11-13])  and  formats  them  into  sequences  for  input  to  RECURRENT.  Appendix  C 
contains  the  source  listing  for  RECURRENT,  which  is  based  on  the  RECNET  code 
[Lindsey,  1991:58-74].  RECURRENT  implements  a  real  time  recurrent  learning 
algorithm.  Appendix  D  contains  the  source  listing  for  UTILITIES:  these  subroutines 
are  accessed  by  function  calls  from  FORMAT_RCST  and  RECURRENT.  All  of  these 
programs  are  written  in  "ANSI  C"  for  use  on  a  NeXTstadon  computer. 

A.1  File  Structure 

FORMAT_RCST  and  RECURRENT  are  written  to  use  the  following  file 
structure.  All  executable  files  are  stored  in  a  single  (base)  directory.  Within  the  base 
directory,  all  of  the  RCS.TOOLBOX  wideband  radar  signatures  are  stored  in  a  single 
(signatures)  subdirectory.  This  directory  name  must  be  written  as  the  "path"  variable  in 
FORMAT_RCST.  The  signatures  directory  may  be  further  divided  as  desired  (sorted 
by  aircraft,  for  example).  These  subdivisions  must  be  written  as  filename  extensions 
for  the  "jet”  variables  in  FORMAT.RCST.  Also  within  the  base  directory,  a  new 
subdirectory  should  be  created  for  each  test  case.  FORMAT.RCST  writes  data  files  to 
the  case  directory  (overwriting  existing  d^  files  that  have  the  same  filenames). 
RECURRENT  uses  the  case  directory  to  read  input  data  and  to  write  output  data  (again, 
ovowriting  existing  output  files  with  the  san»  filenames). 

A.2  FORMATJtCST 

Different  versions  of  FORMAT_RC^T  must  be  compiled  for  each  different  test 
case.  Test  cases  are  described  using  the  "#define”  statements  in  FORMAT.RCST  (ref: 
B-1,  B-2).  FORMAT_RCST  may  be  run  multiple  times  to  create  training  data  from 
one  set  of  aspect  angles  and  test  data  from  a  different  set:  this  is  done  by  commenting 
out  sections  of  MAIN  within  FORMAT_RCST  (ref:  B-S).  FORMAT_RCST  also 
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[Hxxluces  "setup”  files  that  control  the  RECURRENT  neural  network  architectiue  (ref: 
B-12).  FORMAT_RCST  is  invoked  by  typing: 


fonnat_rcst  case 

where  "case"  is  an  existing  directory.  The  following  data  and  setup  files  are  written  to 
the "  case"  directory  (caution:  existing  files  with  the  same  names  are  overwritten): 

feature .  statistics  computed  values  from  training  data 
test_f eature .  statistics  echoed  values  from  FORMAT_RCST, 

created  only  if  the  "altemate_statistics_flag"  is 
set  (ref:  B-2). 

undetected. aircraft  aspect  angles  where  an  aircraft  has  fewer 

range  birrs  after  windowing  than  the  desired 
number  of  peak  range  bins.  Bug:  the 
minimum  target  width  is  1  range  bin,  not  0. 
mig2 1 .  res t_data  diagnostics  file,  typically  commented  out 

clean_list  .unnormalized  training  feature  values  with  no  noise 
train .  setup  RECURRENT  setup  file 

train  RECURRENT  training  data,  with  sequences 

presented  in  random  order 

train. unnormalized  typically  commented  out  (ref:  B-13) 

check .  setup  RECURRENT  setup  file 

check  RECURRENT  training  data,  with  sequences 

listed  in  a  defined  order 

check. unnormalized  typically  commented  out  (ref:  B-13) 

test .  setup  RECURRENT  setup  file 

test  RECURRENT  test  data,  with  sequences 

listed  in  a  defined  nder 
typically  commented  out  (ref:  B-13) 


test .unnormalized 


A.3  RECURRENT 


The  recunent  neural  network  architecture  is  defined  by  the  "train,  setup" 
file.  This  defines  the  size  of  the  weight  matrix  and  most  of  the  training  parameters 
(epochs,  alpha,  etc).  Setup  files  are  used  for  all  three  data  input  files:  this  allows  each 
file  to  have  a  different  number  of  sequences  and  a  different  sequence  length.  Bug:  the 
sequence  length  analysis  subroutine  assumes  equal  sequence  lengths.  RECURRENT  is 
invoked  (with  a  random  initial  weight  matrix)  by  typing: 

recurrent  case 

where  "case"  is  an  existing  directory  containing  the  FORMAT_RCST  data  files. 
RECURRENT  may  also  be  invoked  (with  a  user-defined  initial  weight  matrix)  by 
typing: 


recurrent  case  weightsfile 


where  "case"  is  an  existing  dii?ctory  containing  the  FORMAT_RCST  data  files,  and 
"weightsfile"  is  an  existing  file  with  a  i»opeily  sized  weight  matrix.  For  both 
methods,  the  following  data  and  setup  files  are  written  to  the  "case"  directory 
(caution:  existing  files  with  the  same  names  are  overwritten): 


weights . initial 
weights . final 
weights . restart 
epochs 


length. check 


randomly  generated  weight  matrix 
weight  matrix  after  training 
echoes  a  user-defined  initial  weight  matrix 
mean  squared  error  and  accuracy  results  for 
each  training  epoch  and  for  one  test  epoch. 
This  file  is  formatted  for  NXYPLOT,  a 
plotting  program  for  NeXT  computers, 
accuracy  versus  sequence  length  (ref:  Section 
3.4.4)  for  "check"  data,  computed  during  the 
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length. test 


signatures . check 


signatures . test 


sequences . check 


sequences . test 


test  epoch.  This  is  formatted  for  NXYPLOT, 
a  plotting  program  for  NeXT  computers, 
accuracy  versus  sequence  length  (ref:  Section 
3.4.4)  for  "test"  data,  computed  during  the 
test  epoch.  This  is  formatted  for  NXYPLOT, 
a  plotting  program  for  NeXT  computers, 
actual  and  desired  output  node  values  for  the 
"check"  data  (signature  by  signature), 
computed  during  the  test  epoch 
actual  and  desired  output  node  values  for  the 
"test"  data  (signature  by  signature), 
computed  during  the  test  epoch 
diagnostics  on  sequence  classification  (not 
very  useful),  computed  during  the  test  epoch 
diagnostics  on  sequence  classirication  (not 
very  useful),  computed  during  the  test  epoch 
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Appendix  B.  FORMAT_RCST  Source  Code 


This  appendix  contains  the  FORMAT_RCST  source  code.  The  various  functions 
of  FORMAT_RCST  are  described  in  Section  3.3. 


/•  £onnat_rc8t .c  ••*••»•*****»•»•••»•*••*••**•*♦*•**•*••»*•••••**•**«••*•»* 

This  program  reads  ‘.wbCable*  files  created  by  the  program  PTDTABLE  and 
formats  the  data  for  ii^ut  to  a  recurrent  neural  network.  The  * .wbtable* 
data  format  is  described  in  the  RCS_TOOLBOX  User's  Guide  [Bramley  and  others, 

1991 :A,  11-13].  PTOTABLE  operations  are  also  described  in  the  RCS_TOOLBOX 
User's  Guide  [Bramley  and  others,  1991 :Ch  9,  1-3].  The  program  RECURRENT 
(described  in  ^pendlx  C)  Implements  the  recurrent  neural  network. 

Each  line  in  the  output  files  have  the  following  format: 

{  [elevation  tag],  [azimuth  tag],  [azimuth  feature  value],  [target  width  feature  value], 
[LV  an^lltude  1],  [LH  amplitude  1],  [LV  amplitude  2],  [LH  amplitude  2]...  (etc,  for  all 
desired  range  bins  describing  each  signature) ,  [class  1  output  node  desired  value] , 
[class  2  output  node  desired  value] . . .  (etc,  for  all  target  classes)  } 

Multiple  lines  are  listed  to  complete  each  sequence.  Multiple  sequences  are 
listed  to  coac)lete  the  data  file. 

Written  Pall  1992  by  Eric  T.  Kouba 


/ 


tinclude  <8tdio.h> 
#include  <math.h> 
tinclude  <stdllb.h> 


char  *path  =  {  "rc8t_8ignature8/''  ); 
char  •directory; 


/•  Directory  containing  all  iiq>ut  files.  */ 
/•  Target  directory  to  place  output  files. 
The  target  directory  must  already  exist. 
Any  existing  files  with  the  same  names  as 
the  output  files  will  be  overwritten.  •/ 


tdeflne  recursion 


/•  The  number  of  times  to  pass  through  the 
data  creation  loops.  Useful  for  getting 
multiple  exaa^les  of  noisy  data.  •/ 


idefine  aircraft  5  /•  Number  of  target  classes,  with  the 

subdirectory  and  file  name  prefixes 
within  the  •path  directory,  above.  •/ 

char  •jet [aircraft]  =  {  ■mig21/mig21_’,  •£4/f4_’.  ’flS/flS.’,  ‘fie/fie.*,  •£18/fl8_‘  }; 


•define  rc8t_azimuthj}egin  60  /•  .wbtable  signature  index  to  begin  and  •/ 

•define  rc8t_azlmuth_end  90  /•  end  reading.  This  index  corresponds  to 

the  target  azimuth.  •/ 

int  rc8t_azimuth  >  rc8t_azlvuth_end  -  rc8t_azimuth_begin  *  1; 

/•  Signatures  per  target  per  elevation.  •/ 

•define  rcst_elevatlon  11  /•  Number  of  .«A>table  files  per  target  class. 
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with  each  file  containing  data  from 
different  elevations.  */ 


char  *rc8t_file[rcst_elevation]  =  {  •el50_*,  •el40_*,  •el30_",  •el20_’,  *ellO_",  ■el00_’, 

•el_10_*,  •el_20_’,  •el_30_*.  ■el_40_’.  ’el.SO."  ); 

/*  Example  .vd>table  path  and  filename; 

*rcst_signatures/Big21/mig21_el25_lv.td>table* 
containing  the  LV  polarized  data  for  a  MiG-21 
at  2.S  degrees  elevation.  */ 

•define  azimuthwOffset_slgma  2.0  /*  Bias  standard  deviation  in  degrees  between 

truth  and  estimated  azimuth  */ 

•define  azimuth_sigma  0.2  /*  Standard  deviation  for  random  aziiButh  error  */ 

•define  amplitude_8igma  5.0  /*  Scintillation  noisestandard  deviation  */ 

•define  ainplitude_thre8hold  -30.0  /*  ihermal  noise  threshold  */ 

•define  range_bin8  200  /*  .td>table  range  bins  per  radar  signature  */ 

•define  featurejains  1  /*  Desired  nuid>er  of  output  range  bins 

per  target  (feature  range  bins)  *! 

•define  sigs_per_seg  10  /*  Signatures  per  sequence  */ 

•define  node_on  1.0  /*  tanh  values  for  the  recurrent  net  */ 

•define  node_off  -1.0 

•define  altemate_statl8tic8_flag  0  /*  0  to  use  calculated  values  */ 

•define  lnput_az_mean  75.000000  /*  FORMAT_RCST  confutes  data  statistics  */ 

•define  li4>ut_az_8igma  8.973265  /*  for  normalization.  External  values  */ 

•define  input_width_mean  42.854546  /*  can  be  used  instead  by  setting  the  */ 

•define  liQ>ut_width_sigma  18.506121  /*  flag  =  1.  Useful  for  creating  test  */ 

•define  lnput_aiip_mean  -14.737031  /*  data.  */ 

•define  input.amp.sigma  12 . 598812 


PILE  *0penJPlle2();  /•  Subroutines  from  UTILITIES. C.  */ 

FILE  *OpenuElle4 < ) i 
int  Get_Integer() ; 

float  Uniform_Eandom() ;  /*  RANl.C  from  Numerical  Recipies  in  C.  *! 

int  lnteger_8eed; 

float  0au88ian_Randam ( ) ;  /*  GASRAM.C  from  Numerical  Recipies  in  C.  *! 

float  *Vector(); 

int  **lnteger_|fatrlx() ; 

float  •••Matrix_3D(); 


FILE  •LV; 

FILE  'LH; 

FILE  •RCST.DATA; 

FILE  *STATISTICS; 

FILE  •UNDETECTED; 

PILE  •FEATURE.DATA; 
FILE  •RBCURRENT.DATA; 
FILE  •RBCURRENT.SETUP; 


int  8eqs_per_el;  /•  Sequences  per  elevation  •/ 

int  total_8ignat\ire8; 
int  total_sequences; 

struct  ( 

float  •••aspect;  /•  elevation  and  azimuth  •/ 

float  •••input;  /•  combined  LV  and  Ui  data  •/ 

int  ••flag;  /•  sequence  marlter  for  random  ordering  •/ 

}  data (aircraft] ; 


/•  LV  polarization,  input  data  •/ 

/•  LH  polarization,  input  data  •/ 

/•  Diagnostic  listing  of  the  raw  .wbtable  data.  •/ 

/•  Output  listing  of  data  statistics.  •/ 

/•  Diagnostic  listing  of  aircraft  and  aspect  angles  that 
are  too  narrow  for  the  desired  nuiober  of  range  bins.  •/ 
/•  Unnormallzed  output  data  •/ 

/•  Normalized  output  data  •/ 

/•  Setup  file  for  output  data  •/ 
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/•  for  statistics  •/ 


float  az_8iw; 
float  az_8quare; 
float  az_jBMn; 
float  az_8lgata; 
float  azjnin; 
float  azjnax; 
float  az_n; 

float  widtlx_sum; 
float  wldtlx_8quare; 
float  widttt_P«an; 
float  wldth_slgma: 
float  width_inin: 
float  widtfaLJzax; 
float  widtlt_d: 

float  aop— sum; 
float  anp_8<iuare: 
float  anpjiean: 
float  aaip_slgma: 
float  anp_jBin; 
float  aiBp_ftax; 
float  aav_p; 

Int  wlndow_8tart;  /*  First  and  last  range  bins  with  a  */ 

Int  vdndow_end;  /*  non-threshold  amplitude  value.  */ 

int  target_r«9rion;  /*  Apparent  target  width.  */ 

int  interval_8tart ;  /*  These  are  used  to  divide  the  target  region  */ 

float  interval_width;  /•  of  interest  into  “n*  intervals,  iidiere  "n*  •/ 

int  Interval.end;  /*  is  the  desired  number  of  range  bins  to  use  */ 

float  ■ax.total.anp;  /*  as  feature  values.  •/ 

int  tagged_rangejt>ln; 

float  *signature_ltu>ut;  /*  Pointers  for  line  by  line  data  processing.  */ 
float  *nolse_input; 
float  *8ignature_output; 

float  8lgnature_lv;  /*  li^ut  data  value.  */ 

float  slgnature_lh; 

float  blA_lv;  /*  Output  data  value.  */ 

float  bia_lh; 

float  aziauth^offset; 
float  azi«uth_noi8e; 
float  azimth_«stimate; 
float  aaplitude_noi8e; 


char  igxiore[80]; 

float  trash; 

int  a; 

int  b; 

int  c; 

int  d; 

int  •; 

int  fi 

int  g; 

int  i.  j; 


/*  aircraft  counter  */ 

/*  elevation  file  counter  */ 

/*  signatures  per  elevation  counter  */ 
/*  sequences  per  elevation  coxinter  */ 
/*  signatures  per  sequence  counter  */ 
/*  total  sequences  counter  */ 

/*  file  recursion  counter  */ 

/*  generic  counters  •/ 


void  XnitialiseO ;  /*  Subroutines  */ 

void  itead-Signatures  ( ) ; 
void  Print_|tcST_Oata(); 
void  Set_Statistics ( ) ; 
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void  Caiapute_Statl8tics  ( ) ; 
void  Bxtract_wldtlv_7eature  ( ) ; 
void  List.Cleao-Sequences ( ) ; 
void  Bxtract_Clean_Peatures ( ) : 
void  Dovmsainple  ( )  ; 
void  Print_Signature() : 
void  Print_]iecurrent_Setup  ( )  ; 
void  RandoiajSequances  ( )  ; 
void  List_Noisy_Sequence8() ; 
void  Bxtract_)l0isy_Peature8  ( ) ; 
void  Add_tloi8e()  : 
void  Priiit_Noi8y_Signature() : 


/•  iiain  program  for  F0IIHAT_RCST  ••*••**•••*••***•****•***••**•••»•••••***/ 

void  main(  int  argc,  char  *argv[l  ) 

{ 

if(  argc  1=  2  ) 

Bxit_M888age(  'Usage:  £ormat_rcst  <directory>*  ); 
directory  =  argv[l]; 

srand(  time(  NULL  ));  /*  Use  the  cheap  Unix  random  number  generator  */ 

integer_8eed  =  -randO;  /*  to  seed  the  high  class  'Numerical  Recipies'  */ 

Unifons_Random(  ainteger.seed  );  /*  generator.  *! 

Initialize  0 ; 


£or(  a  s  0;  a  <  aircraft;  a^^-  )  /*  Read  all  .vd>table  files.  */ 

for(  b  ■  0;  b  <  rcst.elevation;  b+>  ) 

{ 

LV  »  Qpen^lle4(  path,  jet  [a],  rc8t_£ile(b] ,  'lv.vd>table*,  'r'  ); 

LH  s  Open_File4(  path,  jet[a],  rc8t_£ile(bl,  'Ib.vibtable' ,  'r'  ); 
ReadJSlgnatures  ( ) ; 
fcloseC  LV  ); 
f close (  LK  )  ; 

) 

/*  Diagnostics  print  of  raw  .wbtable  data  for  one  aircraft.  */ 
/•  RCSTJDATA  *  Open^ile2  (  directory,  '/mig21.rc8t_data',  'w'  )  ; 

Print_RCST.J)ata  (  a  «  0  ) ; 
f close (  RCST_OATA  ) : 

*/ 


lf(  altemate_8tati8tics_flag  »  1  ) 

{  /*  Use  defined  statistics.  */ 

STATISTICS  ■  0pen_plle2(  directory,  '/test.feature. statistics',  'w'  ) ; 
Set_Statistics() ; 
f close (  STATISTICS  ); 

) 

else 

(  /*  Or  computed  values.  */ 

STATISTICS  c  0pen_Pile2(  directory,  '/feature. statistics',  'w'  ); 
ComputejStatistics ( ) ; 
f close (  STATISTICS  ); 


UMDKTICTBO  ■  0pen_File2(  directory,  '/undetected. aircraft',  'w*  ); 
fprintf(  UMPCTCno,  'cleazL.llsti\n*  ); 

FIATUWfJlATA  «  0paQ_File2(  directory,  */cleai\_llst.unnomalized',  'w'  ); 
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LlstjCleanJSeQuences ( ) : 
£close(  FEATURELDATA  ); 


/*  No  noise  added.  */ 


RECURRENT_SETUP  =  0pen_File2(  directory,  ‘/train. setup* ,  ‘w*  ); 

Print  Jftecurrent_Setup  ( )  ; 

£close(  RECURRENT_SETUP  ): 

fprint£(  UNDETECTED,  ‘\ntrain:\n‘  ); 

FEATURE_DATA  =  0penJPile2(  directory,  ‘/train. unnormalized',  ‘w‘  )  ; 

RECURRENT_DATA  =  Open^ile2 (  directory,  ‘/train* ,  ‘w*  ); 

£or(  g  s  0;  g  <  recursion;  g^-f  ) 

{ 

integer_8eed  s  -randO;  /*  Re-initialize  the  random  seed.  */ 

Uni£om_Random(  Ainteger.seed  ) ; 

Rando(K_Se<iuences ( ) ;  /*  Random  sequence  order,  with  noise.  */ 

) 

£cl08e(  FEATURE-DATA  ) ; 

£close(  RECURRENT_OATA  ); 


RECURRENT_SETUP  =  Open_File2(  directory.  ‘ /check. set  up  * ,  ‘w‘  ) ; 
Print_Jlecurrent_Seti®  ( )  ; 

£cl08e(  RECURRENT_SETUP  ) ; 

£print£(  UNDETECTED,  ‘\nchecki\n‘  ) ; 

FEATURE-DATA  =  Qpen-File2(  directory,  ‘ /check. \3nnormali zed*,  ‘w*  )  ; 
RECURRENT— DATA  =  Open-File2(  directory,  ‘/check*,  ‘w*  ) ; 

£or(  g  s  0;  g  <  recursion;  g-f-f  ) 

{ 

integer— seed  s  -rand ( ) ; 

Uni£orm_Eandom(  ftinteger-seed  ) ; 

List-Noisy-Eequences ( ) ; 

) 

£cl08e(  FEATURE-DATA  ); 

£close(  RECURRENT-DATA  ); 


RECURRENT— SETUP  s  Open-File2(  directory,  ‘/test. setup* ,  'w*  ); 
Print-Recurrent-Setup ( ) ; 

£close(  RECURRENT-SETUP  ); 

integer-seed  *  -randO; 

Ubi£ozm_Random(  6integer_8eed  ) ; 

£print£(  UNDETECTED,  ‘VntestAn*  ); 

FEATURE-DATA  s  Open-File2(  directory,  ‘/test. unnormalized*,  ‘w*  ); 
RECURRENT-DATA  *  0pen-File2 (  directory,  ‘/test*,  ‘w*  ); 

£or(  g  s  0;  g  <  recursion;  g+'f  ) 

{ 

intager-seed  *  -randO; 

Uni£orm_Random(  Ainteger-seed  ); 

List-Noisy-Sequences ( ) ; 

) 

£close(  FEATURE-DATA  ); 

£cl08e(  RECURRENT-DATA  ); 

£close(  UNDETECTED  ); 


) 

/*  end  MAIN  */ 
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/*  Subroutine  to  dtynanically  allocate  memory  •*•**•*•**••••••*•*****•••••/ 

void  Initialize () 

{ 

segs_per_el  >  rcst.azimuth  -  slg8_per_aea  *■  Is 
total_8ignature8  =  aircraft  *  rc8t_elevation  *  rc8t_azlnuth; 
total_aeguencea  3  aircraft  *  rcat_elevation  *  8e<]8_per_el ; 

for(  a  3  0;  a  <  aircraft;  84^4-  ) 

{ 

data(a]  .aapect  3  Matrl;t_3D(  0,  rc8t_elevatlon  -  1.  0,  rc8t_aziButh  -  1,  0,  1  )  ; 
data  [a]  .input  3  Matri;t_3D(  0,  rc8t_elevation  -  1,  0,  rc8t_azimuth  -1, 

0,  (  ran0e_bin8  *  2  )  -  1  ) ; 

data[a].flag  3  integer_Hatrix(  0.  rc8t_elevation-l,  0,  8eq8_per_el-l  ); 

noi8e_ii]put  3  Vector (  0,  (range_bin8  *  2)-l  ); 

8ignature_output  3  vector (  0,  2  *  (featurejsina  *  2)-l  ); 

) 

return; 

> 

/*  end  INITIALIZE  •/ 


/•  Subroutine  to  read  one  .td>t2d>le  file  *•**••*****•••••*••*•***••**/ 

void  ReadLSignaturee ( ) 

( 

for(  i  3  0;  1  <  10;  i'f'f  ) 
fgeta(  ignore,  80,  LV  ); 

fscanfi  LV,  *%f  %f  %f',  ttraah,  atraah,  &data[a] .aspect [b] (0] [0]  >; 
for(  i  3  0;  i  <  10;  i+'f  )  /*  get  the  elevation  */ 

fget8(  Ignore,  80,  LV  ); 
for(  i  3  0;  1  <  20;  i**  ) 
fget8(  Ignore,  80,  LH  ); 

for(  c  3  0;  c  <  rc8t_azimuthJ9egln;  C++  ) 

for(  1  3  0;  i  <  1  +  (rangejbins  *  2);  i++  ) 

{ 

f8canf(  LV,  *%f*,  fctrash  ); 
fscanf(  LH,  *%f*,  Rtrash  ); 

) 


for(  c  3  0;  c  <  rcst.azimuth;  C++  ) 

{ 

data[a] .aspect [b] [c] CO]  3  dataCa] .aspect [b] [0] [0];  /*  elevation  */ 

fscanfC  LV,  *%f*,  AdataCa]  .aspect  [b]  [c]  [1]  );  /*  azianith  */ 

fscanfC  LH,  *%f*,  Atrash  ); 


for(  i  3  0;  1  <  range_bins;  i++  ) 

{ 

fscanfC  LV,  *%f*,  RdataCa] .input [b] [c] [i  *  2]  );  /*  LV  amplitude  */ 

f scant (  LV,  *%f*,  strash  ); 

dataCa] .iivutCb] [c] [1  *  2]  3  (  dataCa) .input [b] [c] [i  *  2]  /  100.0  )  -  200.0; 


fscanfC  LH.  *%f,  RdataCa]. input Cb][c](l  +  <i  *  2)]  );  /•  LH  amplitude  •/ 

fscanfC  LH,  *%f*,  atrash  ); 

data[a].input(b)(c][l  +  (i  *  2)]  -  {  dataCa] .input [b] [c] (1  +  (i  •  2)]  /  100.0  ) 
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/*  Diagnostics  print  of  the  first  few  range  bins  frcst  the  first  signature  */ 
/*  print f(  *%6.1f  %6.1f  data [a] .aspect [b] [0] [0] ,  data [a] .aspect [b] [0] [1]  ); 

for(  i  3  0;  i  <  4;  i-t-t'  ) 

printfC  *%7.2f  *,  dataCa] .input [b] [0] (i]  ); 

printf (  • \n"  ) ; 

*/ 

return; 

) 

/*  end  REAO_SIGHATURES  */ 


/*  Subroutine  to  print  out  the  raw  .vd>table  data  for  one  aircraft  ***»**•••♦**♦******/ 

void  Print_)lCST_Data(  int  a  ) 

{ 

for(  b  3  0;  b  <  rcst_elevation;  b-f-f  ) 
for(  c  3  0;  c  <  rcst.azimuth;  c**  ) 

{ 

fprintfC  RCSTJDATA.  *%6.1f  *,  data(a] .a^>ect tb]  [c]  [0]  ): 
fprintf(  RCST_OATA,  *%6.1f  *,  data[al .aspect [b] [c] [1]  ); 
for(  i  3  0;  i  <  (rangejsins  *  2);  i^-t-  ) 

fprintfC  RCST_DATA.  ■%7.2f  *,  data[a] .input [b] [c] [i]  ) ; 

fprintfc  RCST_PATA,  "Vn*  ); 

> 

retum; 

) 

/*  end  PR1NT_RCST_DATA  */ 


/*  Subroutine  for  using  defined  statistics  to  nomalize  the  data  ••••*•••**•*•***••*/ 

void  Set_Statistics() 

{ 

azjeean  3  ij:vut_az_f)ean; 
az_sigisa  3  input_az_sigaa; 

%ridthJMan  3  input.widthjnean; 
width-SigsM  3  i]^t_width^igna; 
aep_SMan  3  input_asp_|Bean; 
aep_sigm  3  input_aiap_sigma; 

fprintfC  STATISTICS,  *\n\tawan\t\tsigma\n*  ); 
fprintf(  STATISTICS,  *az\t%f\t%f\n*,  azjsean,  az_sig»a  ); 
fprintf<  STATISTICS,  *width\t%f\t%f\n*,  widthjwsn,  widtb-SigaM  ); 
fprintf(  STATISTICS,  *asqp\t%f\t%f\n*.  aap_eean,  aap_sigaa  ); 

return; 

) 

/*  end  SBT_STATISTICS  •/ 


/•  Subroutine  to  coapute  statistical  values  fro*  the  input  data  *•*****•*•••*••••**/ 

void  Cospute_8tatistics() 

{ 

aa_sua  3  O.O;  /*  Initialise  */ 

as_equ*re  *  0.0; 
az_nean  3  o.O; 
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az_8lgma  s  0.0; 

ax_)Bln  s  999.0; 

at_max  s  -999.0; 

az_ii  B  ( float  )total_slgnature8; 

wldth_sum  s  0.0; 

wldth_8quare  =  o.O; 

wldthjMan  =  0.0; 

widtlx_8igma  b  o.O; 

wldth_l8ln  b  999.0; 

wldtlxjux  B  -999.0; 

wldth_n  B  (float)total_8lgnature8; 

anp— sum  =  0.0; 
aia)p_aquare  =  0.0; 
aap_jkean  b  0.0; 
aap_8igMa  s  0.0; 
aBp_i»in  B  999.0; 
aap_8iax  b  -999.0; 

anp_n  b  0.0;  /*  Aaqplltude  statiatlca  are  computed  only  for  values  above 

the  thermal  noise  threshold  */ 

for(  a  B  0;  a  <  aircraft;  a-f-t-  ) 

for(  b  B  0;  b  <  rcst_elevation;  b-f'f  ) 
for(  c  a  0;  c  <  rcst_azimuth;  c-t-f  ) 

{ 

az_8\im  *■=  data[a]  .aspect  (b]  [c]  [1]; 

az_SQuare  -fa  data  [a]  .aspect  [b]  (c]  [1]  *  data[a]  .aspect  [b]  [c]  tH ; 
lf(  data[a] .aspect(b] [c] [1]  <  az_min  ) 
az_mln  a  data[a] .aspect [b] [c] (!]; 
if (data[a] .aspecttb] [c] Cl]  >  azjnax  ) 
asjnsx  a  data [a] .aspect (b] [c] [1]; 

Bxtract_y(idthJ?eature  ( ) ; 

width_suB  (float) target_region; 

width-square  +a  (float) (  target_region  *  target_regian  ); 
if(  ( float )target_region  <  widthjsln  ) 
width_|iin  a  ( float )  target_re0ion; 
if(  ( float )taryet_region  >  vd.dthyjux  ) 
width.jMx  B  (float) target_re9ion; 

for(  1  B  2;  1  <  (rangejsins  *  2);  ) 

if(  dataCa]  .ii9ut[b]  [c]  [1]  >  aBplitudeL.threshold  ) 

{ 

aap_sum  ♦b  data  [a] .  livut  [b]  (c)  [i] ; 

aap_square  «b  data  [a]  .input  [b]  [c]  [i]  *  dataCa]  .iivutCb]  [c]  [i] ; 
if(  dataCa]  .input [b]  to] (1}  <  aapjin  ) 
aqp_ji^n  b  dataCa]  .input(b)  [c]  li]; 
if(  dataCa] .input Cb] [c] [i]  >  amp^pax  ) 
aap_pax  b  dataCa]. inputCb][c](i]; 
aac>_n  **  1.0; 

> 

) 

as_iMan  a  az_sua  /  az_ja; 

az_aigaw  a  sqrtCC  az_n  *  az_8quare  -  as_suB  *  as_sua  )  /  (  as_n  *  (  az_n  -  1  ))); 
width_stean  *  wldth_sum  /  width_h; 

widtlusigsui  ■  sgrt  ( (width_h*width_square-width_sum*width_suai)  /  (width-h*  (width_n-l) ) ) 

aap_jMaa  a  app_sum  /  ai9_n; 

sap^sigma  m  sqrt  ( (  aap_n*aa9_square  -  aap_stti*aBp_suBi  )  /  (  a8p_n  *  (  aap_ji  -  1  ) ) ) ; 
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fprintf ( 
fprlntf ( 
fprintf ( 
fprintf ( 
fprintf ( 
fprintf ( 
fprintf ( 


STATISTICS, 

STATISTICS. 

STATISTICS, 

STATISTICS, 

STATISTICS, 

STATISTICS, 

STATISTICS, 


*\n\tsum\t\ts(juarn\t\t]Bean\t\t8igma\t\tmin\t\tmax\n*  )  ; 
*az\t%f\t%f\t%f\t*,  az_s\i».  az_square,  az_nean  )  ,- 
*%f \t%f\t%f\n'.  az_8igma,  az_nin,  az_nax  ) ; 
'wldth\t%f\t%f\t%f\t*.  width_8uai,  widtl^8quare,  widthjnean  ); 
*%f\t%f\t%f\n*.  width_8igBa,  width^jfiln,  wldth.jnax  ); 
•aiq>\t%f\t%f\t%f\t*,  afflp_8ua,  aop-SQunre,  a]ap_inean  ) ; 
*%f\t%f\t%f\n*,  aBq9_8igma,  aiap_min,  aopjnax  ); 


return; 

} 

/*  end  COMPOTB-STATISTICS  */ 


/*  Subroutine  to  coopute  target  width  baaed  on  the  clean  input  data  •*****•••*••*•* 
Thia  aubroutine  called  only  to  get  atatiatical  data.  *•••••***•*•••••*•*****•*••/ 

void  Bxtract_Wldth_Paature ( ) 

{ 

wlndow_8tart  =  0; 
window_end  *  range_blna  -  1; 

/*  Search  for  the  firat  range  bin  that  haa  a  non-threahold  LV  or  LH  value  */ 
vdiile(  dataCa]  .input [b]  [c]  [window_atart  *  2]  <3  aiaplitude_thre8hold  && 

datafa] .input (b] [c] [1  *  (window_8tart  *  2>]  <>  aaplitude.threahold  && 
wlndow_8tart  <  window_end  ) 
wlndow_atart +4- ; 


/*  Alao  for  the  laat  range  bin  */ 

vdilleC  datata]  .input (b]  [c]  [window.end  *  2]  <s  aaplitude.threahold  && 

dataCa]  .input [b]  [c]  (1  *  (wlndow_end  *  2)]  <■  aiaplitude_thre8hold  && 
wlndow_atart  <  wlndow_end  ) 
wlndow_end — ; 


target_region  *  window_end  -  window_8tart  *  1; 
return; 

) 

/•  end  BXTRACT.WIDTH.FBATUSB  */ 


/*  Subroutine  to  print  formatted,  unnormallzed  output  data,  no  noiae  •••••••••*••••••/ 

void  Ll8t_Clean..Seguence8  ( ) 

{ 

for(  b  >  0;  b  <  rcst_elevation;  b4-4^  ) 
for(  d  3  0;  d  <  8eq8_per_el;  d-^^  ) 
for(  a  3  0;  a  <  aircraft;  a-*'*  ) 

for(  e  3  0;  e  <  8ig8_per_8eq;  e^-^-  ) 

{ 

c  3  d  4’  e; 

BxtractjClean^eatures  ( ) ; 

Print jBignature  ( ) ; 

> 


return; 

) 

/•  end  LI8T_CLIANJSBQUB1CBS  */ 
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/*  Subroutine  to  extract  formatted,  unnomalized  output  data,  no  noise 


/ 


void  Bxtract_Clean-Peatures ( ) 

{ 

8ignature_output[0]  =  data[a] .aspect [b] [c] [1] ; 


vfindow.start  s  0; 
wiitdow_end  s  range_bins  -  1: 


vdUle(  data[a]  .input tb]  [c]  [window_8tart  *  2]  <=  amplitude.threshold  && 

data[a]  .input tb]  [c]  [1  *  (window_8tart  *  2)]  <=  aiiiplitude_threshold  &£ 
window_start  <  window_end  ) 
windoML.start  >4 : 


iid)ile(  dataCa]  .input [b]  [c]  [windowL.end  *  2]  <s  aaiplitude.threshold  ££ 

data[a]  .input [b]  [c]  [1  4^  (window_end  *  2)]  <=  amplitude_threshold  ££ 
window_start  <  window_end  ) 
windo«r_end — ; 


target_region  s  window_end  -  window_start  *  1; 
8ignature_output[l]  »  ( float )target_region; 

Downsainple(  data[a]  .input[b]  [cl  ) ; 


/•  Get  the  target  width  */ 

/*  And  downsample  the  range  bins 
to  get  the  desired  number  */ 
/*  of  amplitude  featxires.  */ 


return; 

} 

/•  end  BXTRACT_CLEAK_FEATUItBS  */ 


/*  Subroutine  to  perform  a  max  out  of  n  downsample.  Divides  the  target  region  of 

interest  into  m  intervals  of  range  bins  «diere  m  is  the  desired  number  of  range  bins 
to  pass  as  feature  values.  The  LV  and  U<  amplitudes  for  each  selected  range  bin 

are  passed  as  feature  values.  ***•«•••*•***••**•••••***•*•••*•*•*•***•*•*••••*•*•*/ 

void  DownsaRple(  float  *8ignature_lnput  ) 

{ 

if(  target_reglon  o  featurejjins  )  /*  If  the  target  has  fewer  range  bins  than  */ 

{  /*  the  desired  number  of  feature  range  bins  */ 

fprintf(  UNDBTBCTEO,  ’aircraft  %d,  elevation  %d,  azimuth  %d:  *,  a,  b,  c  ); 

fprintf(  UNDETECTED,  '%d  range  binsNn*,  target_regian  ) ; 


for(  i  a  0;  i  <  featurejbins;  i**  ) 

( 

if(  i  <  target_region  )  /*  Use  all  range  bins  in  the  target  window  */ 

i 

if(  8ignature_iivut [ (window_8tart  4  i)  *  2]  <  amplitude_threshold  )  /*  LV  */ 

signature_output [2  4  (i  *  2)]  s  amplitude.threshold; 

else 

signature_output (2  4  (i  *  2)]  =  slgnature_input [ (window_start  4  1)  •  2]; 


lf(  signature_livut[l  4 
signature_output[3  4 

else 

slgnature_output [3  4 


) 

else 

{ 

signature_output[2  4  (i 
signature_output(3  4  (i 

) 


( (window_start  4  i)  *  2) ]  <  aaplitude_threshold  ) 

(i  *  2)1  a  amplitude_threshold;  /*  LH  */ 

(i  *  2)1  a  signature_input[l  4 

( (windowustart  4  1)  *  2)1; 

/*  and  then  pad  with  thermal  noise  values  */ 

*  2)1  a  amplitude_threahold; 

*  2)  ]  a  amplltudeL.thre8hold; 
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) 

) 

els*  /*  There  ere  enough  range  bins  In  the  target  window  */ 

( 

lnterval_8tart  =  wlndow_8tart; 

intervaljwidth  »  ( float) target_reglon  /  (float) featurejsins; 

/*  Divide  the  target  into  intervals  of 
range  bins.  Select  one  range  bin  fron 
each  interval  based  on  max  pic)c.  */ 

for(  i  s  0;  i  <  featurejbins;  i-t-f  ) 

{ 

interval_end  >  window.start  *  (int)(  interval.width  *  (float)  (  i  'f  1  ) ) ; 
max-total_aiqp  »  2.0  *  amplitude_threshold; 

8ignature_lv  s  amplitude.threshold; 

8ignature_lh  s  anplitude.threshold; 
tagged_range_bin  s  lnterval_8tart; 

for(  j  s  interval_start;  j  <  interval_end;  j't-'f  ) 

{ 

if(  8ignature_lni>ut[j  •  2]  <  aii9litude_t)u:e8hold  )  /•  LV  •/ 

bln_lv  =  amplitude.threshold: 

else 

bih_lv  s  signature.iiqput  [ j  *  2]; 

if(  8ignature_ii^t(l  ♦  (j  •  2)1  <  amplitude_threshold  )  /*  LH  •/ 

bin_lh  3  amplitude.threshold; 
else 

bln_lh  3  slgnature_input(l  *  (j  *  2)1; 

lf(  binjlv  *  bin^h  >  max_total_amp  ) 

{ 

max_total_aaip  s  binL.lv  * 

8ignatuare_lv  3  bin_lv> 

8ignature_lh  3  bia_lb; 
tagged_rangejbin  s  j; 

) 

) 

8ignature_output[2  (1*2)]  3  slgnature.lvi 
signet ure_output [3  4-  (i  *  2)]  3  8lgnature_lh; 

lnterval_start  3  lnterval_end; 

) 

) 

return; 

) 

/*  end  DOHNSAMPLB  •/ 


/*  Subroutine  to  print  one  line  of  formatted,  unnormalized  output  data,  no  noise  **•**/ 

void  Print_Signature() 

{ 

fprintf(  FBATUR«j)ATA,  ‘AO.lf  *,  datala) .aspect [b] (cl [0]  );  /*  elevation  */ 

fprintf(  FIATUR«J]ATA,  '%6.1f  *,  data[a]  .a^ectlb]  [c]  [1]  );  /*  azimuth  */ 

for(  i  3  Oj  i  <  2  +  (featurejsins  *  2)>  )  /*  azimuth,  width,  */ 

fprintf(  ntATUItS_PATA.  *%7.2f  *,  signature_output[i]  );  /*  and  amplitudes  */ 

for(  i  3  0;  i  <  aircraft;  i**  ) 
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i£(  i  »  a  ) 

£print£(  FBATUIIBJ3ATA,  •%4.1£ 
else 

£prlnt£(  PEATUKE_DATA,  ■%4.1£ 


node_on  ) : 
node_o££  ) ; 


£prlnt£(  FEATURE_I>ATA,  ‘Nn*  ); 


return; 

) 

/•  end  PRIWP_SIGNATORB  •/ 


/*  Subroutine  to  print  a  settv  £lle  £or  the  program  RECURRENT 


/ 


void  Print_Recurrent^etup  (  char  ^extension  ) 
{ 


£prlnt£(  RECURRENT_SETUP, 
£print£(  RECURRENT_SETUP, 
£prlnt£(  RECURRENT_SETUP, 
£print£(  RBCURRENTJSETUP, 

£print£(  RECURRENT_SETUP. 
£prlnt£(  RECURRENT_SETUP, 
£prlnt£(  RBCURREtlT_SETUP, 
£prlnt£(  RECURRENT_SETUP, 
£print£(  RBCURRENT_SETUP. 
£print£(  RBCURRENT_EETUP, 


*%d  : Input  teatures  >=  l\n',  2  *  ( £eature_bins  *  2)  ); 

*td  :output  classes  >*  l\n',  aircraft  ); 

*0  : hidden  nodes  >=  0\n'  ); 

*%d  stotal  sequences  >=  l\n*.  total.sequences  * 

recursion  ) ; 

*%d  t signatures  per  sequence  >=  2\n',  sigs_per_seq  ); 

*100  : training  q>ochs  >s  0\n*  ); 

*0.0001  ! learning  step  size  alpha  >  O.OVn*  ); 

*3  : sigmoid  flag,  1  linear,  2  exp  sigmoid,  *  ); 

*3  tanh  sigmoidXn*  ) ; 

*2  ;batch  learn  flag,  1  fraite,  2  sequence,  3  epochVn*  ) 


rettim; 

) 

/*  end  PRINT_EECORRBIT_SBTUP  */ 


/•  Subroutine  to  print  noisy  sequences  in  a  random  order  (training  data)  •**••*•••••/ 

void  Randaa(_sequences  ( ) 

{ 

for(  a  s  0;  a  <  aircraft;  a»  ) 

for(  b  >  0;  b  <  rcst_elevati«i;  b^-^  ) 

£or(  d  >  0;  d  <  seqs_per_el;  d^*  ) 

data [a] .flag [b] [d]  ^  0;  /*  mark  each  sequence  with  a  flag  */ 

for(  f  >  0;  f  <  total_sequences;  f*^'  ) 

{ 

a  *  (Int)  (  thii£ora_3tandaai(  alnteger_seed  )  *  (float) aircraft  ); 
if(  a  as  aircraft  ) 

a  ■  aircraft  -  1;  /*  generate  a  randcsi  target  class  */ 


b  a  (int)  (  unifozaLJtandom(  6integer_seed  ) 
if(  b  aa  rcst_elevatlon  ) 

b  a  rcst_elevation  -  1;  /* 


*  ( float )rcst_elevatian  ); 
randosi  elevation  */ 


d  a  (int)  (  UnifozaLjtandom( 
if(  d  aa  seqs_per_ei  ) 
d  a  seqs_per_el  -  1; 


ainteger_seed  )  *  ( float )seqs_per_el  ); 


/*  randosi  azimuth  to  begin  the  sequence  */ 


ebile(  data(a].£lag(b](d]  aa  i  ) 
{ 


/*  search  from  that  point  through  the  */ 
/*  sequences  until  you  find  a  sequence  */ 
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d4"f;  /*  that  has  not  yet  gone  into  the  file  */ 

if(  d  segs_per_el  ) 

{ 

d  >  0; 
b++; 

if(  b  ss  rcst_elevation  ) 

{ 

b  -  0; 

a-f-t'; 

i£(  a  ==  aircraft  ) 
a  s  0; 

) 

) 

) 

data[a] .flag[b] [d]  =  1;  /*  Mark  the  sequence  flag  */ 

/*  Generate  the  azimuth  bias  that  allies 
to  all  signatures  in  the  sequence.  */ 
aziaiuth_offset  s  azimuth._offset_8igma  *  GsussianLJiandom(  fcinteger_seed  ); 
if(  azimuth-offset  >  3,0  *  azimuth-Offset.sigma  ) 
aziffiuth-Offset  s  3.0  *  azimuth-offset-sigma: 
if(  azimuth-Offset  <  -3.0  *  azimuth_off set— sigma  ) 
azimuth-Offset  =  -3.0  *  azimuth-offset-Sigma; 

for(  e  =  0;  e  <  sig8-per_seq;  04-+  ]  /*  Loop  over  all  signatures  per  sequence  */ 

{ 

c  s  d  -4  e; 

Bxtract-Noisy-Features ( ) ; 

Print-Hoisy-SignatureO :  /•  noisy,  normalized  data  •/ 

/•  Print-Signature () !  •/  /*  noisy,  uiuiormalized  data  •/ 

) 

) 

return; 

} 

/•  end  RANDOC.SBQUENCES  */ 


/*  Subroutine  to  print  noisy  sequences  in  aspect  angle  order  (test  data)  ••••*•*•••*/ 

void  List-Hoisy_Sequences() 

{ 

£or(  b  >  0;  b  <  rest— elevation;  b-;-*  ) 
for(  d  -  0;  d  <  seqs_per-el;  d4-4-  ) 
for(  a  s  0;  a  <  aircraft;  a^^*  ) 

{ 

azimuth-Offset  >  azimuth-Offset-Sigma  *  0au88ian-Random(  fcinteger-seed  ); 
lf(  azimuth-Offset  >  3.0  *  azimuth-offset-sigma  ) 
azimuth-Offset  s  3.0  *  azimuth-offset-sigma; 
lf(  azimuth-Offset  <  -3.0  *  azimuth-Offset-Sigma  ) 
azisnith-Offset  >  -3.0  *  azimuth_of f set— sigma; 

for(  e  >  0;  e  <  8igs_per_8eq;  e^^  ) 

{ 

c  >  d  4-  e; 

Bxtract-Holsy-Features ( ) ; 

Print-Hoi 8y_Signature ( ) ; 

/*  Print-SignatureO ;  •/ 

) 

) 

return; 

) 


/*  end  L1ST_N0ISY_SBQUENCBS  */ 


/•  Subroutine  to  add  noise  to  the  noise-free  RCS  TOOLBOX  signatures,  and  extract 
features  based  on  the  noisy  data  values 

void  Bxtract_Noisy_;Peatures() 

( 

Add_))oise  ( ) : 

signature_output[0]  s  aziiituth_estimate; 

window_start  3  O; 
window_end  &  range_bins  -  1; 

wbile(  noise_input [window_start  *  2]  <=  amplitude_threshold  && 

noise_ii^tt[l  -t-  (window_start  *  2)]  <=  amplitude_threshold  && 
window_start  <  vd.ndow_end  ) 
window_start  : 

vdiile(  noise_ii9Ut [vd.ndow_end  *  2]  <=  aiiiplitude_threshold  && 

noise_input  [1  +  (windaw_end  *  2)]  <=  aiiqplitude_threshold  && 
window_start  <  window_end  ) 
window_end — ; 

target_region  3  %d.ndow_end  -  window_start  >1;  /*  Get  the  target  width  */ 

signature_output [1]  3  ( float )target_region; 

Downsasqple (  noise_input  );  /*  Select  amplitude  features  */ 

return; 

) 

/*  end  BXTRACr_N01SY_FEAT0RES  */ 


/*  Subroutine  to  add  gaussian  noise  to  the  aziaiuth  and  to  each  amplitude  in  the 
noise-free  RCS  TOOLBOX  data  files 

void  Add_Koise() 

{ 

azimth-hoise  3  azimuth-sigma  *  Gausslan_Random(  Rinteger_seed  ) ; 
if(  azinuth_noise  >  3.0  *  aziinuth_6igsia  ) 
azinutiunoise  3  3.O  *  azinuth-Sigina; 
if(  azianith_noise  <  -3.0  *  azimuth^sigaa  ) 
azimnith^noise  3  -3.0  *  azimuth_signa; 

azianith_estiaiate  3  data(a]  .aspect  (b]  [c]  [1]  azignith_offset  *  aziiButh_noise; 

for(  i  3  0;  i  <  (range_bins  *  2);  i-i-^  )  /*  Loop  over  all  amplitude  values  */ 

{ 

amplittide_noi8e  s  asplitude_slga«  *  Gausslan_Randoat(  &lnteger_seed  ): 
if<  aaplitude_noise  >  3.0  *  aaplitude_sigM  ) 
amplltude_nol8e  3  3.0  *  aaplitude_slg]aa; 
if(  aaplitude_noi8e  <  -3.0  *  aaplitude_sigaa  ) 
aaplitude_noise  3  -3.0  *  aaplitude_sigma; 

noisau.ii]put(il  *  data(a]  .input[b]  (c]  [i]  +  aaplitude_noisei 

) 

return; 
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) 

/*  end  ADD_NOISE  */ 


/*  Subroutine  to  print  one  line  o£  formatted,  normalized,  noisy  data  •*••*•**•*••/ 

void  Print_lJoi8y_Signature( ) 

( 

£print£(  RECURRENT_nATA,  •%6.1£  ",  data [a] .aspect [b] [c] [0]  ) ; 

£print£(  RECORRENT_nATA,  •%6.1£  •,  dataEa) .aspectib] [c] [1]  ) ; 

fprlntfE  RECURRBNT_nATA,  "tS.ef  ",  (  8lanature_output [ 0]  -  az_mean  )  /  az_8i9ma  ) ; 

£printf(  RBCURRENT_nATA,  ■%9.6£  *,  (  elgnature_output [ 1 ]  -  width_mean  ) 

/  widtb_sigma  ) ; 

£or(  i  =  2;  i  <  2  +  ( £eature_bins  *  2);  ) 

£print£(  RECORRENr_DATA,  •%9.6£  *,  (  8ignature_output [ i ]  -  anp_mean  ) 

/  amp_8igma  ) ; 

£or(  i  =  0;  1  <  aircraft;  i++  ) 

{ 

if{  1  ==  a  ) 

f print f(  RECURREMr_DATA,  •%4.1f  *,  node_on  ) ; 

else 

fprintf(  RECUFRENT_DATA,  •%4.1f  *,  node_off  ); 

) 

fprint£(  RECURRENT, OATA,  ’Vn*  ) ; 
return; 

) 

/•end  PRINT JIOISY_SIGNATURE  •/ 


/•end  FORMAT JICST  •/ 
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Appendix  C.  RECURRENT  Source  Code 


This  appendix  contains  the  RECURRENT  source  code.  It  is  based  on  a  real-time 
recurrent  learning  algorithm  [Williams  and  Zipser,  1989:270-280].  This  computer 
program  is  an  updated  and  expanded  version  of  RECNET  [Lindsey,  1991 :58-74]. 


/*  recurrent .c  **•••*•••*•*••*•**•»•••»••***••••••»••••••••••*****••••»••••••*•** 

This  program  is  a  real-time  recurrent  learning  algorithm  modified  for  radar 
target  identification.  Input  vectors  are  tagged  %«ith  target  azimuth  and  elevation 
values.  Vectors  are  arranged  in  sequences,  with  a  fixed  sequence  length.  Each 
sequence  represents  high  range  resolution  radar  data  measured  as  the  target  aspect 
angles  change. 

Bach  line  in  the  input  files  have  the  following  format: 

{  [elevation  tag] ,  [azimuth  tag] .  [azimuth  feature  value] .  [target  width  feature  value] , 
[LV  aa^litude  1],  [LH  amplitude  1].  [LV  amplitude  2].  [LH  amplitude  2]...  (etc,  for  all 
desired  range  bins  describing  each  signature) ,  [class  1  output  node  desired  value] , 
[class  2  output  node  desired  value]...  (etc.  for  all  target  classes)  ) 

This  format  applies  only  to  the  radar  target  identification  problem.  The  real  time 
recurrent  learning  algorithm  in  this  program  is  written  general  enough  to  tumdle 
other  problems,  such  as  XOR  and  function  prediction. 

Original  code  written  Stimmer  1991  by  Randall  L.  Lindsey 
Updated  and  modified  Fall  1992  by  Eric  T.  Kouba 


/ 


finclude  <8tdio.h> 
flnclude  <math.h> 
finclude  <stdlib.h> 


fdefine  bias  1 

fdefine  exp_sigmold_threshold  0.2 
fdefine  temh_slgaK>ld_threshold  0.4 


/*  If  the  different  (setween  desired  and  actual  */ 
/*  output  node  values  is  less  than  threshold,  */ 
/*  then  the  output  node  is  "right’.  •/ 


void  Exlt_)les8age( ) ;  /*  Subroutines  from  UTILITIES. C  */ 

PILE  *Open_File2() ; 

PILE  *0pen_Pile3 ( ) ; 
int  Get_Integer ( ) ; 

float  Unifons_Random() ;  /*  RANl.C  from  Numerical  recipies  in  C.  */ 

int  integer.seed; 

float  *Vector(); 

float  “MatrlxO; 

float  •••Matrix_3D() ; 


FILE 

•SETUP; 

/• 

PILE 

•DATA; 

/• 

PILE 

•WEIGHTS; 

/• 

PILE 

•SIGNATURES; 

/• 

PILE 

•LENGTH; 

/• 

PILE 

•SEQUENCES; 

/• 

PILE 

•EPOCHS; 

/• 

Contains  net  architecture  and  data  file  size  parameters  */ 
Input  file  for  training  and  tes  data  */ 

Input  and  output  file  for  the  weights  matrix  */ 

Output  file,  giving  node  by  node  aiid  line  by  line  listing  of 
desired  versus  actual  output  values.  */ 

Output  file,  giving  epoch  accuracy  based  on  sequence  length. 
Output  file,  classifies  each  sequence  (not  very  useful).  *f 
Output  file,  giving  meems  squared  error,  alpha,  percent 
right,  and  percent  good  for  all  data  during  training.  */ 


*/ 
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char  *directoxy; 

char  * weight s_{llename; 

char  coanentstSO] ; 

int  lower.llinit; 

int  iiq>ut8; 

int  outputs; 

int  hidden; 

int  output_layer; 

int  input_layer; 

int  epochs; 

float  alpha; 

int  sigmoid-flag; 

int  leam_flag; 


/*  Target  directory  to  read  ii^nits  and  write  outputs.  */ 
/*  Existing  weights  file  name  for  restarting  the  net.  */ 


/*  Number  of  ii^t  nodes  */ 

/*  Number  of  output  nodes  */ 

/*  Number  of  hidden  nodes  *! 

/*  Output  plus  hidden  nodes  =  number  of  output  layer  nodes.  */ 
/*  Bias  plus  input  plus  output  plus  hidden  =  itq>ut  layer.  */ 

/*  Training  epochs.  Set  =  0  for  a  testing  run.  */ 

/*  Initial  learning  step  size  */ 

/*  Marks  type  of  non-linear  function  to  use.  */ 

/*  Batch  mode  flag  to  show  when  to  do  weight  t4>dates.  */ 


struct  { 

int  sequences; 
int  signatures; 
int  all-data; 
float  *elevatlon_tag; 
float  *azimuth_tag; 
float  **z; 
float  **d; 

}  data [3]; 


float  *right— length; 
float  *good_length; 


/*  Number  of  sequences  */ 

/*  Number  of  signatures  per  sequence  */ 

/*  Total  number  of  data  vectors  */ 

/*  Aspect  angle  tags  are  not  used  as  features  */ 

/*  External  and  feedlsack  inputs  */ 

Desired  outputs  */ 

data[0]  for  training,  data[l]  for  check,  data[2]  for  test  */ 
Variable  *c*  switches  between  data  files.  */ 

Number  of  sequences  that  were  classified  'right*  */ 
and  'good*,  for  all  possible  sequences  lengths.  */ 


float  **w; 

float  **delta-w; 

float  ••batch-deltajw; 

float  *8; 

float  *ys 

float  *y-prime; 

float  •**p_t; 

float  ***p— t-plusl; 

float  ***p_te«p; 

float  sum; 

float  kronecker; 

float  *e; 

float  J[2]; 

float  *mean-de8ired; 

float  *meaa_output ; 


/*  Weight  matrix  •/ 

/*  Weight  iqpdate  based  on  a  single  training  vector  */ 
/•  Batch  weight  tqxlate  •/ 

/*  Result  of  vector*matrix  multiply,  before  sigmoid  */ 
/*  vector*iiiatrix  multiply  with  sigmoid  applied  */ 

/*  Derivative  of  node  outputs  w.r.t.  %<eight8  */ 

/*  Previous  partial  derivatives  matrix  */ 

/•  Current  partial  derivatives  matrix  •/ 


/•  Delta  function  */ 

/*  Desired  -  actual  =  error  for  output  nodes  */ 

/*  Mean  squared  error  per  output  node  */ 

/*  Average  desired  node  value  over  a  given  sequence  */ 

/*  Average  actual  node  output  value  over  a  given  sequence.  */ 


float  threshold; 
int  rlght-Outputs; 
int  right-Signatures; 
int  right-last-signature; 
int  epoch-Tight-signatures; 
int  rlght-sequences— vote; 
int  right— sequences-mean; 
int  right- sequences— last ; 


/•  For  getting  a  node  'right*  •/ 

/*  Number  of  nodes  with  abs (desired  -  actual)  <  threshold  */ 
/*  Number  of  signatures  classified  right  in  a  sequence  */ 

/*  flag  if  the  last  signature  in  a  sequence  was  'right*  */ 

/*  Total  number  of  signatures  classified  within  threshold  */ 
/*  Number  of  sequotces  classified  'right*  by  voting  all  */ 
/*  signatures,  by  taking  the  average  signatxire  outputs,  */ 
/*  and  by  using  only  the  last  signature  in  the  sequence.  */ 


float  max-Output; 
int  max-Output-index; 
float  max-desired; 
int  aax.jdesired_index; 
int  good-Signatures; 
int  good-last-signature; 
int  epoch^ood-slgnatures; 
int  good-sequences-vote; 
int  good_sequences_mean; 
int  good-sequences-last; 


/*  Value  of  the  maxlsnim  actual  output  */ 

/*  Index  of  the  node  with  max  actual  output  */ 

/*  Value  of  maximum  desired  output  */ 

/*  Index  of  the  node  with  max  desired  output  */ 

/*  Signature  classified  good  if  index  of  max  desired  and  */ 
/*  max  actual  are  the  same  node.  */ 
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int  nat.flag; 
int  a; 
int  b; 

Int  c: 
int  t; 
int  u; 

int  i,  j,  k,  1; 


/*  Flag  for  either  training  or  testing  the  net.  */ 

I*  Epochs  loop  counter  */ 

!*  Sequences  loop  counter  */ 

/*  Data  file  pointer,  1  for  training,  2  for  check,  3  for  test  */ 

/*  Time  counter,  for  signatures  per  scsquence  *! 

I*  Alternate  time  counter,  used  only  for  sequence  length  auialysis  */ 
/*  generic  counters  */ 


void  Read_Setup ( ) ;  /*  Subroutines  */ 

void  Read_Oata ( ) : 

void  Allocate_Ha8u»ry()  ; 

void  Iaitialize_Weights( ) ; 

void  Read_Weights ( ) ; 

void  Save_Weights() ; 

void  Print_Headers ( ) ; 

void  Net ( ) : 

void  Initialize_^och() ; 
void  Initialize_Sequence ( ) ; 
void  lnitialize_Signature() ; 
void  Propagate (); 
void  Conpute_Error ( ) ; 
void  Classify_Signature() ; 
void  Coiqpute.Output  ( ) ; 
float  Bj9_Sigztold(  float  x  )  ,- 
float  Tanh_Slgmold (  float  x  ); 
void  Coapute_Delta_Weights ( ) \ 
void  CoBipute_P() ; 
void  Leeum  ( ) ; 
void  Print_Signature ( ) ; 
void  Clas8ify_Sequence() ; 
void  Print_Sequence ( ) ; 
void  Adjust_Alpha( ) ; 
void  Print_Sequence_j:,ength() ; 
void  Print_Epoch ( ) ; 


/•  main  program  for  RECURRENT  •***••**••••*••••••**•***•*••••*•••******•*•••••/ 

void  main(  int  argc,  char  *argv[]  ) 

{ 

if(  argc  Is  2  aa  argc  Is  3  ) 

Bxit_)ies8age (  ’Usage:  recurrent  «lirectory>  Iweights.filenam]  *  )  ; 
directory  s  argv[l];  /*  Target  directory  for  input  and  output  files  *! 

if(  argc  ss  3  ) 

vraight8_filename  s  argv[2];  /*  Filename  for  an  existing  weights  matrix.  */ 


SETUP  s  0pen_Pile2(  directory,  ’/train. setup*,  ’r*  ); 

ReadJSetw(  c  s  o  ); 
f close!  SETUP  ); 
if(  epochs  Is  0  ) 

(  /*  Read  training  data  if  there  are  training  epochs  to  run  *! 

DATA  s  0penJFile2(  directory,  ’/train*,  ’r’  ); 

Read_Data (  c  s  o  ) ; 
f close!  DATA  ); 

) 


SETUP  s  0pen_File2!  directory,  ’/check. set  tv ’,  ’r’  ); 
Read-Setup!  c  s  i  ); 
f close!  SETUP  ); 


C-3 


DATA  X  OpeQ_Pile2(  directory,  ■/check",  "r"  ); 
Read_Data (  c  x  i  ) • 
f close (  DATA  ) ; 


SETUP  X  0peiv_File2(  directory,  '/test. setup*,  "r*  ); 
ReadjSetup (  c  x  2  ) ; 

£close(  SETUP  ): 

DATA  X  0i>en_File2(  directory,  "/teat",  ’r"  ); 
Read_Data (  c  x  2  ) ; 
fclose (  DATA  ) ; 


Allocate_Keniory() ;  /*  Dynamic  allocation  for  matrix  memory  */ 

i£(  argc  x=  2  )  /*  I£  no  weights  filename  specified,  */ 

{ 

initializeJHeights ( ) ;  /*  Generate  a  random  weight  matrix.  */ 

WEIGHTS  X  0peix_?ile2(  directory,  ‘/weights. initial",  "w*  )  ; 

} 

else 

{ 

WEIGHTS  X  0pen^ile3(  directory,  */*,  weight s_£ilename,  *r*  ) ; 

ReadJWeights ( ) ; 
fclose (  WEIGHTS  ): 

WEIGHTS  X  0pen_Rlle2(  directory,  "/weights. restart",  *w*  ) ; 

) 

Save_Weights ( ) ;  /*  Save  the  starting  weights  */ 

fclose (  WEIGHTS  ); 


WEIGHTS  X  cipen_Pile2(  directory,  "/weights. final",  *w*  ); 

EPOCHS  X  0pen_pile2(  directory,  "/epochs",  "w*  ); 

Print_Headers (  net_£lag  x  O  );  /*  Print  screen  and  file  headers  */ 


for(  a  X  0;  a  <  epochs;  a4"»  ) 

{ 

Net(  c  X  0,  net_£lag  x  0  ); 
Net  (  c  X  1 ,  net_£lag  x  i  ) ; 

) 


/*  Loop  over  all  training  epochs  */ 

/*  Train  the  net,  perform  weight  updates  */ 
/*  Check  data,  no  updates  */ 


SavejWeights ( ) ; 
fclose (  WEIGHTS  ); 

/*  Training  complete,  print  results  */ 
SIGNATURES  x  0pen_File2(  directory,  "/signatures. check",  "w*  ); 

SEQUENCES  x  Open_Pile2 (  directory,  ’/sequences. check",  *w*  ): 

LENGTH  X  Open_pile2(  directory,  ’/length. check",  "w*  ); 

PrintjHeaders (  net_£lag  >  2  ); 

£prlnt£(  LENGTH,  ‘1 check"  ); 


Net(  c  X  1,  net_£lag  x  2  );  /*  Print  results  versus  check  data  file  */ 

fclose (  SIGNATURES  ); 
fclose (  SEQUENCES  ); 
fclose (  LENGTH  ); 


SIGNATURES  x  0peiv_pile2(  directory,  "/signatures. test",  "w*  ); 
SEQUENCES  x  0pen_Plle2(  directory,  "/sequences. test",  "w"  ); 
LENGTH  X  0pen..Jile2(  directory,  ’/length. test",  *w*  ); 
Print_}ieaders (  net.flag  x  2  ); 
fprlntfC  LBIGTH,  "I test’  ); 
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Net (  c  s  2 ,  net_£lag  s  2  ) ; 


/*  Print  results  versus  test  data  file  */ 


f close (  SIGNATURES  ); 
£close(  SEQUENCES  ); 
£close(  LENGTH  ); 
£close(  EPOCHS  ); 

) 

/*  end  MAIN  •/ 


/*  Subroutine  to  read  in  the  net  architecture  and  data  file  size  parameters  •*****•**•/ 

void  Read-Setup (  Int  c  ) 

{ 

if(  c  ss  0  )  /*  If  training  set^  file  *! 

{ 

inputs  s  Get_Integer(  SETUP,  lower_limit  z  1  ); 
outputs  =  Get_Integer(  SETUP,  lower_limit  =  1  ); 
hidden  s  Get_Integer(  SETUP,  lower_llmit  ss  0  ) : 

output-layer  =  outputs  *  hidden; 
input-layer  =  bias  *  Inputs  *  outputs  4-  hidden; 

printf(  '%d  ii^ut,  %d  output,  %d  hidden  nodes\n\n*,  ii^uts, 

) 

else  /*  Skip  for  check  and 

for(  1  =  0;  i  <  3;  i+>  ) 

fget8(  ccoments,  80,  SETUP  ); 

data [c] .sequences  s  Get-Integer<  SETUP,  lower_limit  »  1  >;  /*  Humber  of  sequences  •/ 

data [c] .signatures  *  Get-Integer(  SETUP,  lower_limit  a  2  ); 

/*  Signatures  per  sequence  */ 

data[c] .all— data  s  data (cl .sequences  *  data(c] .signatures; 

if(  c  sz  0  }  /*  It  training  setup  file  */ 

{ 

epochs  z  Get-Integer (  SETUP,  loMer-llmit  z  0  ); 

fscanfC  SETUP,  '%f*,  &alpha  ); 
fget8(  comments,  80,  SETUP  ); 
lf(  alpha  <z  0.0  ) 

Bxlt-|lessage(  'alpha  <z  0.0  in  setup  file*  ); 

sigmoid-flag  z  Get-Integer (  SETUP,  lower-limit  z  o  ); 
if(  sigmoid-flag  zz  i  | |  sigmoid-flag  zs  2  ) 
threshold  z  esqp-sigmold-threshold; 
else  if(  sigmoid-flag  am  3  ) 

threshold  *  tanh-slgsraid-threshold; 
else 

Exlt-HessageC  *t>ad  output  flag  in  setvp  file*  ); 

learo-flag  z  Get-lnteger(  SETUP,  lower-limit  z  0  ); 

if(  learu-flag  iz  i  aa  leam-flag  !z  2  aa  leam-flag  !z  3  ) 

Exit-Nessage (  'bad  learn  flag  in  setup  file*  ); 

) 

return; 

) 

/•  end  READ-SETUP  */ 


outputs,  hidden  ) ; 
test  setup  files  '/ 
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/•  Subroutine  to  read  all  vectors  in  a  data  file  ••*•*•••*••••••*•*****•*•*••••••/ 

void  Read-Data (  int  c  ) 

{ 

data[c] .elevatlon_tag  =  vector (  0,  data[c] .all_data  -  1  ); 
data[cl .azimutb-tag  =  Vector(  0,  data(c] .all_data  -  1  ): 
data[c].z  s  Matrix(  0,  data [c] . all-data  -  1.  0,  input-li^er  -  1  ); 
data[c] .d  =  Matrix(  0,  data [c] . all-data  -  1,  0,  outputs  -  1  ); 

for(  i  =  0;  i  <  data[c] .all_data;  1++  ) 

{ 

fscanf(  DATA,  *%f',  &data[c] .elevation-tag[i]  ); 
fscanf(  DATA,  *%f*,  fcdata[c] .azinuth-tagti]  ); 

data[c] .z[i] [0]  =  1.0; 
for(  j  >  0;  j  <  Inputs;  j-f-f  ) 

£scan£(  DATA,  *%£*,  &data(c] .z[il [j  *  bias]  ); 

£or(  j  =0;  j  <  output— layer;  j-t-*  ) 

data[c] .z[i] t j  *  bias  *  inputs]  ^  0.0;  /* 

£or(  j  -  0;  j  <  outputs;  ) 

£scan£(  DATA,  *%£*,  AdataCc] .d[i] [ j]  ); 

) 

print£(  *%d  sequences,  %d  slgnaturesNnVn* ,  data [c] .sequences,  data (c] . signatures  ); 
return; 

) 

/*  end  RBAD-DATA  */ 


/*  Aspect  angle  tags  are  not  */ 
/*  used  as  feature  values  */ 

/*  Unifom  bias  */ 

/•  Input  features  •/ 

Initialize  all  feedback  inputs  */ 

/•  Desired  outputs  */ 


/*  Subroutine  to  dynaodcally  allocate  matrix  memory  •••*•••*•••******•***••**•*•*•/ 

void  Allocate-KemoryO 
{ 

w  *  lfatrix(  0,  output-layer  -  1,  0.  input— layer  -  1  );  /*  Weights  */ 

deltajw  =  Matrix (  0,  output-layer  -  1,  0,  ii^ut-layer  -  1  );  /•  Height  updates  •/ 


batch-deltauw  =  Matrix(  0,  output-layer  -  1,  0,  input-layer  -  1  );  f*  update  batch  •/ 
s  X  Vector(  0,  output— layer  -  1  );  /*  Vector*matrix  multiply,  before  sigmoid  */ 

y  3  Vector(  0,  output— layer  -  1  );  /*  Vector*Mtrix  multiply,  after  slgaK>id  */ 

y-prime  3  Vector(  0,  output-layer  -  1  );  /*  Derivative  of  outputs  w.r.t.  weights  */ 

P— t  3  Matrix-3D(  0,  output-layer  -  1,  0,  input— layer  -  1,  0,  output— layer  -  1  ); 

/*  Previous  partial  derivatives  matrix  */ 
P-t-plusl  3  Matrix_30(  C,  output-l«v«t  -  1,  0,  input-layer  -  1,  0,  output-layer  -  1  ); 

/*  Current  partial  derivatives  matrix  */ 
e  3  vector(  0,  outputs  -  1  );  /*  Error  3  desired  -  actual  */ 

right— length  3  Vector (  1,  data (1]  .signatures  -  1  );  /*  Coiutters  for  sequ«)ce  */ 
good-length  3  Vector(  1,  data[l] .signatures  -  1  );  /*  length  analysis  */ 

mean-desired  s  vector (  0,  outputs  -  1  );  /*  Average  desired  output  for  a  sequence  */ 

mean-Output  3  vector (  0,  outputs  -  1  );  /*  Average  actual  output  for  a  sequence  */ 

return; 

) 

/*  end  ALLOCATE-MBMCEIY  */ 
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/*  Subroutine  to  generate  a  random  weight  matrix  ******•••**•**••******•*••••••/ 

void  initialireJHeightsO 
{ 

srand(  time(  NULL  ));  /*  Use  the  cheap  Unix  random  number  generator  *! 

integer_8eed  z  -randO;  /*  to  seed  the  high-class  Numerical  Recipies  */ 

Unl£orm_ltandom(  alnteger_seed  ) ;  /*  generator  */ 

prlntf(  'random  weight  matrixXn*  ); 

£or(  i  s  0;  i  <  output_layer;  i-*-+  ) 

{ 

£or(  j  a  0;  j  <  input_layer:  j++  ) 

{ 

w[i][j]  a  2  *  Uni£omjRandom(  &integer_seed  >  -  1.0;  /*  Ot-l.+l]  */ 

print£(  •%£  wti][j]  ) ; 

} 

print£(  'Nn'  ); 

) 

printf (  • \n'  ) ; 
return; 

) 

/*  end  INITIALIZE  WEIGHTS  */ 


/*  Subroutine  to  read  an  existing  weight  matrix  ***••••••*•**••***••*•*****•••/ 

void  ReadJMeights ( ) 

{ 

printf (  'reading  traight  matrixVn'  ); 

£or(  i  a  0;  i  <  output_layer;  i'f'f  ) 

{ 

£or(  j  a  0;  j  <  iiH>ut_layer;  ) 

{ 

fscanfC  WEIGHTS,  '«£',  fcw[i](j]  ); 
print£(  '%£  '.  wfiJtjJ  ); 

} 

printf (  '\n'  ); 

) 

printf (  '\n'  ); 
return; 

) 

/*  end  REAO_WEIGHTS  */ 


/•  Subroutine  to  save  a  weight  matrix  to  a  file  •***••••••*****•**••*•**••••***/ 

void  SaveJMeightsO 
{ 

for(  i  a  0;  i  <  output_layer;  i>>  ) 

{ 

for(  j  a  0;  j  <  iivut_layer;  ) 

fprlntf(  WEIGHTS,  •%£  ',  W[i](jl  >; 

£yxliit.£(  WEIGHTS,  *\n'  ); 

) 

return; 

) 
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/*  end  SAVB_VIE1GHTS  */ 


/*  sxibroutlne  to  print  screen  and  file  headers.  The  exclamation  points  allow  epoch 
files  to  be  read  directly  by  ■NXYPLOT"  for  plotting.  •*•*••*•*•****••••*****/ 

void  Print_lleaders  (  int  net_flag  ) 

{ 

if(  net_flag  xs  0  )  /*  Training  and  check  file  headers  *! 

( 

fprintfC  EPOCHS,  * ! \t\t\t\tsignatures\t\t\t\tvote\t\t\t\tmean\t\t\t\tlast\n*  ); 
fprintf(  EPOCHS,  * lepochXtdistance  alpha\trlght\t\tgood\t\trlght\t\tgood\t\t'  ): 
fprintf(  EPOCHS,  •rlght\t\tgood\t\tright\t\tgood\n*  ); 

printf(  *\t\t\t\tsignatures\tvote\t\tmean\t\tlast\n*  ) ; 
printf(  ■ epochs tdi stance  alpha\tright\tgood\trlght\tgood\t'  ); 

printf(  *right\tgood\trlght\tgood\n*  ): 

) 

if(  net_flag  xx  2  )  /*  Test  file  headers  */ 

{ 

fprintf(  SEQUEtiCES,  *8tart\t\t\t\tvote\t\t\tmean\t\t\tlast\n‘  ) ; 
fprlntf(  SEQUENCES,  ‘elevation  azimuthStright  goodXt*  )  ,- 

fprintf(  SEQUENCES,  *right\t\tgood\t\tright\tgood\n’  ) ; 

fprintf(  SIGNATURES,  ‘elevation  azimuth\tactual\t\t\tdesired\n*  ); 

) 

return; 

) 

/*  end  PRZNT_hbaders  */ 


/*  Primary  subroutine  for  real  time  recurrent  learning  •••*•*••••••***••••••***/ 

void  Net(  int  c,  int  net_flag  ) 

{ 

ZnitializeJ^pochO ;  /*  Set  epoch  counters  to  zero.  */ 

for(  b  X  0;  b  <  data[c]  .sequences;  b-*-*-  ) 

{ 

Znitialize_SeQuence<) ;  /*  Set  sequence  counters  to  zero.  */ 

for(  t  X  0;  t  <  data [c]  .signatures;  t^-f  ) 

{ 

Initialize_Signature<) ;  /*  Set  signature  counters  to  zero.  */ 

PropagateO;  /*  Vector*matrix  multiply  */ 

Coaqpute_Srror() ;  /*  Difference  betwen  desired  and  actual  outputs  */ 

Classify_Signature() ;  /*  Classify  outputs  for  the  current  time  step  */ 

if(  net_flag  xx  2  )  /*  If  testing  */ 

Print_Signature ( ) ; 

ComputejOutput  ( ) ; 

if(  net_flag  xx  0  ) 

{ 

Coaqpute_Pelta_>(eights  ( ) ; 

Compute_P(); 


C-8 


/*  Apply  the  sigmoid  or  tanh  non-linearity  */ 

/•  If  training  •/ 

/*  Compute  weight  updates  for  current  time  step  */ 
t*  Perform  gradient  descent,  compute  new 
partial  derivatives  matrix  */ 


i£(  leam_£la9  ==  1  )  /*  Check  £lag  •/ 

LearnO;  /*  Ai^ly  weight  vipdates  a£ter  every  time  st^  */ 

) 

) 

Cla8si£y_Seguence( ) ; 

i£(  net_£lag  »  2  )  /*  if  testing  */ 

{ 

Print_Sequence ( ) ; 

i£((  b  1  )  %  outputs  ss  0  ) 

£print£(  SEQUBiCES,  *\n*  ): 

) 

i£(  net_£lag  ss  0  &&  leam_£lag  ==  2  )  /*  If  training,  check  flag  */ 

LeamO;  /*  Apply  weight  updates  after  every  sequence  */ 

) 

i£(  net_£lag  ==  0  )  /•  If  training  •/ 

{ 

i£(  leanv_£lag  ==  3  )  /*  Check  flag  •/ 

LeamO;  /*  Apply  weight  updates  at  end  of  epoch  */ 

Adjust_Alpha ( ) ;  I*  Decrease  learning  step  size,  if  required  */ 

fprint£(  EPOCHS,  *!%4d:\f,  a  +  1  ); 
print£(  ■%4d!\t‘,  a  +  1  )  ; 

) 

else  i£(  net_£lag  sz  1  )  /*  If  running  through  check  data  during  training  */ 

{ 

£printf(  EPOCHS,  *1  check: \n%d\f,  a  ♦  1  )  ; 
print£(  'check: \t*  ); 

} 

else  i£(  net_£lag  zs  2  &&  c  as  i  )  /*  if  running  through  check  data  during  testing  */ 

{ 

Print_Sequence_LengthO ;  /*  Print  net  accuracy  versus  sequence  length  */ 

fprint£(  EPOCHS,  'check: \t'  ); 
print£(  'check: \t'  ); 

) 

else  /*  If  running  through  test  data  */ 

{ 

Print^Sequence_LengthO :  /*  Print  net  accuracy  versus  sequence  length  */ 

£printf(  EPOCHS,  'ltest:\t'  ); 
printf(  'te8t:\t'  ); 

) 

Print_npoch() ;  /*  Print  cumulative  epoch  results  */ 

return; 

) 

/•  end  NET  */ 


/•  Subroutine  to  zero  epoch  counters  •*•*•*•****••*****•*••••********•*•***•**•*•••/ 

void  lnitialise_fpoch() 

( 

epoch_right_signature8  z  0; 
rigbt_sequence8_vote  >  0; 
right_sequences_eean  z  0; 
right_8equence8_la8t  z  0; 
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«poclx_goo(}_signatures  =  0; 
goo4_8equences_vote  s  0; 
goo<l_se<iu«nces_jnean  s  0; 
good_sequences_la8t  =  0; 

J(l]  =  O.Oj  /•  Mean  square  error  for  current  epochs  •/ 

fort  1  s  0;  i  <  output_layer:  i++  ) 
fort  j  =  0;  j  <  input_layer;  j++  ) 

batch_(ielta_wti]  [j]  =  O.O;  /•  initialize  batch  updates  •/ 

fort  t  3  1;  t  <  data [1]  .signatures;  t-t-f  ) 

{ 

right_length[t]  s  0.0; 
good_length[t]  =  0.0; 

} 

return; 

) 

/•  end  IMlTIALZZ5_fP0CHS  •/ 


/*  Subroutine  to  zero  sequence  counters  •••**•**•***•*••*••••*•**»•*»*»*••••***/ 

void  Znitiallze_Sequencet) 

( 

rlght_slgnatures  3  O; 
rlght_last_8lgnature  =  0; 
good_slgnatures  3  O; 
good_last_8ignature  3  0; 

fort  1  3  0;  1  <  outputs;  ) 

{ 

nean_desired[i]  3  o.O; 
mean_output[i]  3  o.O; 

) 

fort  i  3  0;  i  <  output_layer;  i++  ) 

{ 

y[il  =  0.0;  /•  Actual  outputs  */ 

y_prime[l]  3  0.0;  /•  Derivative  of  outputs  w.r.t  weights  •/ 

fort  j  3  0;  j  <  lnput_layer;  j++  ) 
fort  k  3  0;  k  <  output_layer;  k*-*-  ) 

P_t[i](j][k]  3  p_t_plusl (1]  [  j]  [k]  3  0.0;  /*  Petrtial  derivatives  oiatricies  *! 

) 

return; 

} 

/*  end  IMITIALIZEjSBQUaiCE  */ 


/•  Subroutine  to  zero  signatture  counters  *••••*••***••*•»••••••••**•****•••••*••/ 

void  Inltlalize_Signaturet) 

{ 

right_output8  3  0; 
max_Otttput  3  -99.0; 
ma;t_output_index  3  -i; 
maM_de8ired  3  -99.0; 

M^_desired_lndex  3  -i; 
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/*  Error  */ 


tor(  1  s  0;  i  <  outputs;  i**  ) 
eti]  =  0.0; 

£or(  i  3  0;  1  <  output_layer;  i**  ) 

{ 

8[i]  =  0.0;  /*  Node  activation  */ 

for(  j  =  0;  j  <  input_layer;  j**  ) 

deit^k_w[i]  [j]  s  0.0;  /*  Initialize  weight  \q>dates  (not  batch)  */ 

) 

return; 

) 

/*  end  INITIALIZE-SIGNATUSE  */ 


/*  Subroutine  to  conpute  input  vector  *  weight  matrix  multiply  for  current  time  stq>  *•*/ 

void  Propagate () 

{ 

£or(  i  s  0;  1  <  output_layer;  i**  ) 

data[c].z[b  *  data  [c]  .signatures  +  t][i  *  bias  -t-  ir^uts]  =  y[i]; 

£or(  i  =  0;  i  <  output_layer;  i++  ) 

£or(  j  =  0;  j  <  lnput_layer;  ) 

s[l]  '»'=  w[i][j]  *  data[c].z[b  *  data  [c]  .signatures  +  t][j]; 

return; 

) 

/*  end  PROPAGATE  ♦/ 


/•  Subroutine  to  coqpute  desired  -  actual  output  node  values  •**•*•*•*••••*•*•**•*••/ 

void  Coapute_Error ( ) 

{ 

if(  t  =3  0  )  /*  No  error  computations  for  first  time  step  */ 

return; 

for(  i  3  0;  i  <  outputs;  i**  ) 

( 

e(i]  3  data[c}.d[b  *  data [c]  .signatures  t]{l]  -  yCH; 

J[l]  -fs  0.5  *  e[i]  *  e[l];  /*  Sum  up  the  mean  squared  error  over  all  */ 

}  /*  sequences  and  signatures  */ 


return; 

) 

/•  end  C(3MFUTR_BRR0R  */ 


/*  Subroutine  to  classify  the  node  outputs  for  the  current  time  step  *••*••**•*•••*•*/ 

void  Classify_Signature() 

{ 

if(  t  3.  0  ) 

return; 

for(  i  3  0;  1  <  outputs;  i**  ) 
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1£(  £abs(  data[c].d[b  *  data [c] .signatures  +  t]ti]  -  y[i]  )  <=  threshold  ) 
rlght_output  s**} 

i£(  right_outputs  ==  outputs  )  /*  i£  all  actual  and  desired  outputs  are  close,  */ 

{ 

rlght_signatures++;  /*  increment  the  "right*  counters.  */ 

epoch-right.signatures^-^ ; 
i£(  t  »  data [c] .signatures  -  1  ) 
right_la8t_signature  s  1; 

) 

£or(  i  s  0;  1  <  outputs;  l+>  ) 

{ 

i£(  data[c].d[b  *  data [c] .signatures  *  t]Cll  >  Buo(_desired  ) 

{ 

max..deslred  s  data[c].d[b  *  data(cl  .signatures  *■  tl[i]: 

niax.desired_index  si;  /•  Find  index  o£  max  desired  output  node  */ 

} 

i£(  y[il  >  max_output  ) 

{ 

max^output  =  y(i]; 

max.output_index  =  i;  /*  Find  index  o£  max  actual  output  node  */ 

) 

) 

i£(  maxLjdesired^lndex  ==  max_output_index  ) 

{  /*  I£  indicies  statch,  then  max  pick  worked  */ 

good_signatures4.4.;  /*  increment  “good*  counters.  */ 

epoctugood-signatures-fi-  ; 

1£(  t  3=  data [c] .signatures  -  1  ) 
good_last_signature  s  i; 

) 

£or(  i  3  0;  1  <  outputs;  i>+  ) 

(  /*  Sum  up  outputs  £or  each  signature  in  a  sequence  */ 

mean_de8ired(l]  >3  data[c].d[b  •  data [c] .signatures  +  tlti]  / 

(  data [c] .signatures  -  1  ); 

mean^output(i]  +3  y(i]  /  (  data [c] .signatures  -  1  '; 

) 

return; 

) 

/*  end  CLkSSIFy_SIGIikTURE  */ 


/*  Subroutine  to  print  the  node  outputs  £or  the  current  time  step,  during  testing  ***••/ 

void  Prlnt_Slgnature() 

{ 

£print£(  SIOUTUSES,  •%6,1£  *,  data[c]  .elevatioix_tag[b  *  data[c}  .slgnatxires  +  t]  ) ; 

£prlnt£(  SIGMATURBS,  *%6.1£  *,  data(c]  .azlmutlv_tag[b  *  data [c]  .signatures  4-  t]  ); 

£or(  i  3  0;  i  <  outputs;  i+y  ) 

£print£(  SIGNATURES,  •%9.6t  *,  y(i]  >;  /•  Actual  outputs  •/ 

£or(  i  3  0;  i  <  outputs;  i++  )  /*  and  desired  outputs  •/ 

£print£(  SIGNATURES,  *%5.2£  *,  data[c].d[b  *  data [c] .signatures  +  t] [i]  ); 

i£(  t  3.  0  ) 

£print£(  SIGNATURES,  ‘start*  ); 

else 

( 

i£(  right_output8  3s  outputs  ) 

{ 

£print£(  SIGNATURES,  *  *  ); 

right_length[t]  +3  i.O; 
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) 

else 

£print£(  SIGNATURES,  ’wrong  •  ) ; 

1£(  max_(lesire<}_lndex  ==  inax_output_lndex  ) 
{ 

£print£(  SIGNATURES,  •  •  )  ; 

goo<l_length[t]  'f=  1.0; 

) 

else 

£printf(  SIGNATURES,  ’bad  •  ) ; 

) 

£prlnt£(  SIGNATURES.  ’Nn*  ) ; 
return; 

) 

/*  end  PRINT_SIGNATURE  •/ 


/*  Subroutine  to  apply  the  non-linearity  fimction  *••**»*••••**••***»**••****•*••/ 

void  Coiiipute_Output  ( ) 

( 

i£(  sigiBoid_£lag  ==  1  )  /*  Use  a  combination  o£  linear  outputs  and  */ 

{  /*  sigmoid  hidden  nodes.  */ 

£or(  i  =  0;  i  <  outputs;  i++  ) 
y[il  «  a[il; 

£or(  i  s  0;  i  <  hidden;  i^-f  ) 

y(i  *  outputs]  =  E;q;>_Sigmoid(  s[i  -t-  outputs]  ); 

} 

else  i£(  sigmold_£lag  ss  2  )  /*  Use  standard  sigmoid  */ 

£or{  i  3  0;  i  <  output.layer;  i++  ) 
y[i]  3  E;q>_Sigmold(  sCl]  ); 


else 

£or(  i  3  0;  1  <  output_layer;  i4-i-  ) 
y[i]  3  Tantv-Sigmoid (  s[l]  ); 

return; 

) 

/*  end  C0IIPUT5_CX>TP0T  •/ 


/*  Use  tanh  £unction  */ 


/•  Subroutine  £or  the  sigmoid  £unction  **•**•**••••••*•*••***•*•••••••/ 

£loat  Bxp_Slgmoid(  £loat  x  ) 

{ 

static  £loat  maxliBum_value  s  50.0; 

i£(  X  >  iiaximum_value  ) 
return  1.0; 

else  1£(  X  <  -maximuiiL.value  ) 
return  0.0; 

else 

return  1.0  /  (  1.0  *  exp (  -x  ) ) ; 

> 

/•  end  SXP^IGHOID  */ 
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/*  Subroutine  for  the  tanh  function 


/ 


float  Tanh_Sigmoid (  float  x  ) 

{ 

static  float  maximusuvalue  =  25.0; 

if(  X  >  maximum_value  ) 
return  1.0; 

else  if(  X  <  -maxiinuiD_value  ) 
return  -1.0; 

else 

return  tanh(  x  ) ; 

) 

/*  end  TANH_SIGMOID  */ 


/*  Subroutine  to  compute  weight  updates  for  the  current  time  step  •*••»**»•»•*••••*•*/ 

void  Conpute_Oelta_Welghts() 

{ 

for(  i  =  0;  i  <  output_layer;  i++  ) 
for(  j  =  0;  j  <  input_layer;  j++  ) 

{ 

for(  k  =  0;  k  <  outputs;  k++  ) 

deltaL.w[l)tj]  +=  alpha  *  etk}  *  p_t(ij  I  jj  Ik)  ; 
batch_delta_w[i] [j]  +=  delta_wCi) [ j) ;  /*  Sum  into  batch  update  */ 

)  /♦  Apply  updates  after  each  time  step,  sequence,  or  epoch  •/ 

return; 

) 

/•  end  COMPOTE_DELTA_WEIGHTS  •/ 


/•  Subroutine  to  compute  the  new  partial  derivatives  matrix  ••••••••*••••••*•••/ 

void  Compute_P() 

{ 

lf(  slgisoid_flag  ss  1  )  /•  Linear  outputs,  sigmoid  hidden  nodes  */ 

{ 

fcr(  i  =  0;  i  <  outputs;  i-f-f  ) 
y_prime[i]  s  i.O; 
for(  1  s  0;  1  <  hidden;  i**-  ) 

y_prime[l  +  outputs]  »  y[i  ♦  outputs]  •  (  1.0  -  yli  +  outputs]  >; 


else  if(  8igmoid_flag  **  2  ) 

for(  1  »  0;  i  <  output_layer;  !♦+  ) 
y_prime[i]  »  y[i]  •  (  1.0  -  y[lj 

else 

£or(  1  ■  0;  1  <  output_layer;  > 
y_priske[i]  ■  1.0  -  (  y(il  •  y[i) 


/*  SigaK>ld  for  entire  output  layer  */ 
); 

/*  Tanh  function  for  output  layer  */ 
); 


for(  1  ■  0;  1  <  output_layer;  i**  ) 
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for(  j  =  0;  j  <  ii^ut.layer;  j++  ) 
for(  k  =  0;  k  <  output_layer;  k-*-*  ) 

{ 

kronecker  =  0.0; 
if  (  i  ==  k  ) 

kronecker  s  1.0; 
sum  s  0.0; 

for<  1  s  0;  1  <  output_layer;  1++  ) 

sum  ♦=  w[k] [1  +  bias  +  Inputs]  •  p_t[i][j][13; 

P_t_pluslti] [j] [k]  =  y_prime[kl  • 

(sum  +  kronecker  *  dlata[c].z[b  *  data[c]  .signatures  4-  t][j]  ); 

}  /*  Cooqpute  new  P  matrix  based  on  old  P  matrix  */ 

p_temp  =  p_t; 

P_t  =  P_t_plusl;  /•  Swap  pointers,  now  P_T  is  the  current  P  matrix  •/ 

p_t_plusl  =  p_temp; 

retu  ,; 

} 

/•  end  COMPUTe_P  */ 


/•  Subroutine  to  apply  the  weight  updates  and  reset  batch  mode  update  ••*»••••*••••••••**/ 

void  Learn () 

( 

for(  i  s  0;  i  <  output_layer;  i*+  ) 
for(  j  »  0;  j  <  ii^ut.layer;  j**  ) 

( 

w(i][j]  4-«batch_delta_w[l][j]; 
batch_delt<t_w[i]  (j]  *  0.0; 

) 

return; 

> 

/*  end  LBARN  •/ 


/*  Subroutine  to  classify  a  seguence  based  on  time  step  outputs  ••••**•*•*•••••••••/ 

void  Classify_Seguence() 

{ 

if(  right_slgnatures  »  data [c] .signatures  /  2  ) 

right_saquences_vote4"»;  /•  Majority  vote  scheme  •/ 

if(  good-signatures  >*  data [c] .signatures  /  2  ) 
good_seauence8_vote» ; 

Initialize_Signature() ;  /•  Reset  signatxire  stats  (dual  use  variables)  */ 

for(  i  B  0;  1  <  outputs;  l4"»  ) 

lf(  fabs(  mean_deslred(i}  -  aean_output (i]  )  <«  threshold  > 
right_outputS4"4 ; 
if(  right.outputs  outputs  ) 

right_se(iuences_mean4'4;  /•  Average  output  per  tine  step  */ 

for(  1*0;  i  <  outputs;  I**  ) 

( 

if(  moan_dssired(l]  >  max_deslred  > 
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{ 

max_de8ired  =  iiiean_desired[i] ; 
inax_desire<jLindex  s  i; 

} 

if(  meaQ_output  [i]  >  inax_output  ) 

{ 

max_output  =  mean_output [i] ; 
iiiax;_output_index  =  i; 

) 

} 

i£(  max_deslred_lndex  ==  max^output_lndex  ) 

good_sequences_;nean-f 4- ;  /•  Average  output  per  time  step  •/ 

i£(  right_last_signature  ==  1  ) 

right_seQuences_last+4-;  /*  only  look  at  last  time  step  */ 

i£(  good_last_8ignature  i  ) 
good_sequences_la8t44- ; 

return; 

) 

/*  end  CIjASSIFY_SEQUENCE  */ 


/*  Subroutine  to  print  sequence  results  (not  very  useful)  *•«•••••••••••••*•*/ 

void  Print_Sequence ( ) 

{ 

£print£(  SIOIATURES ,  "Vn*  );  /*  Print  aspect  angle  tags  •/ 

£prlnt£(  SEQUENCES,  *%6.1£  *,  data(c] .elevation_tag[b  *  data[c] . signatures]  ); 

£print£(  SEQUENCES,  •*6.1£\t\f,  data(c]  .azimutJv_tag[b  *  data[c)  .signatures]  )  ; 

i£<  right.signatures  >»  data [c] .signatures  /  2  )  /•  Voting  records  */ 

£print£<  SEQUENCES,  •%2d  *,  right_signatures  ); 

else 

£print£(  SEQUENCES,  *%2d  wrong  *,  right_8ignatures  ); 

1£(  good_signature8  >=  data [c] .signatures  /  2  )  /*  Voting  records  */ 

£print£(  SEQUENCES,  *%2d  \t*,  good^signatures  ) ; 

else 

£prlntf<  SBQOEtKes,  •%2d  bad\t*,  good.^signatures  ); 

i£(  right_outputs  ==  outputs  )  /*  Average  time  step  response  */ 

£print£(  SEQUENCES,  •%2d  *,  right_outputs  ) ; 

else 

£print£(  SEQUENCES,  *%2d  wrong  *,  right_outputs  ) ; 

if(  ma;t_<lesired_index  ss  max_output_lndex  ) 
fprintfC  SEQUBICES,  *  \t\f  )  ; 

else  /•  Average  time  step  re^onse  */ 

£print£(  SEQUHTCES,  •  bad\t\f  )  ; 

if(  right_last_8lgnature  ss  i  )  /*  Last  time  step  only  */ 

fprint£(  SBQUBICES,  ’\t'  ): 

else 

fprintf(  SEQUENCES,  *wrong\t*  )  ,- 

if(  goo^Llast_signature  »  1  )  /•  Last  time  step  only  */ 

fprintf(  SEQUBKTES,  *\t*  ); 

else 

fprintf(  SEQUENCES,  ‘badSt*  ); 
fprintf(  SBOUENCSS,  *\n*  ); 
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return; 


} 

/*  end  PRINT_SEQUENCE  */ 


/*  Subroutine  to  decrease  learning  step  size,  if  required 


/ 


void  Adjust^lpha( ) 

{ 

if(  (  J[l]  /  data[0] .all_data  )  <  0.0005  ) 
{ 

printf(  'exit  after  epoch  %d\n*,  a  1 
a  s  epochs: 


/•  If  error  less  than  an  arbitrary  •/ 
/*  amount,  exit  training  */ 

); 

/*  {but  print  results  first)  */ 


if  (  a  <  5  II  Jtl]  <  J[0]  ) 
J[0]  =  J[l]; 

else  if(  J[l]  <  1.01  *  J[01 


else 

{ 

alpha  *=  0.5;  /* 

J[0]  =  J[l]; 

) 


/*  For  first  5  epochs  or  while  error  is  decreasing,  */ 
/*  do  nothing.  */ 

)  /*  If  error  increases  by  less  than  It,  remember  the  */ 

/*  previous  lowest  mean  squared  error  value  in  case  */ 
/•  error  increases  again.  •/ 

If  error  Increases  by  more  than  1%,  decrease  alpha  */ 


return; 

) 

/*  end  ADJUST_MiPHA  */ 


/*  Subroutine  to  print  net  accuracy  as  sequence  length  varies. 

The  output  file  is  formatted  for  reading  and  plotting  by  NXYPLOT  •••*»•••**•**•••••**/ 

void  Print_Sequence_l,ength  0 
{ 

fprintf(  LENGTH,  'NnislgNt  rightXt  goodXn*  ); 

prlntfl  "XnsigVt  rlghtXt  goodXn*  ); 

for(  u  3  1;  u  <  data [1]  .signatures;  u-t-f  ) 

{  /*  bug:  limited  to  >checlc  flle<  signatures  per  sequence  */ 

fprintfl  LENGTH,  •%2dXt',  u  ♦  1  ); 
fprintfl  LENGTH,  'tedXf,  (int) right_length[u)  ); 

fprlntf(  LENGTH,  *%4.1ft%Xt',  100.0  *  rlght_length[u]  /  (float)data[c] .sequences  ): 
fprintf(  LENGTH,  'tSdXf,  (int) good-length [u]  ); 

fprintfl  LENGTH,  *t4.1f%tXn',  100.0  *  good-length [u]  /  (float)data(c] .sequences  ); 

print! (  '%2dXt',  u  >  1  ); 

print! (  *%6dXt*,  (int)right_length[u]  ); 

printf(  * (%4.1f%%)Xt*,  100.0  *  right-length [u]  /  ( float) data [c] .sequences  ); 
print! (  •%6dXt',  (int) good-length (u}  ); 

printf(  ' (%4.1f%%) Xn* ,  100.0  *  good-length (u]  /  (float)data[c] .sequences  ); 

} 

fprintfl  LENGTH,  'Xn*  ); 
print! (  'Xn'  ); 

return; 

) 

/*  end  PRItrr_SBQUBNCB_LIHQTH  •/ 
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/*  Subroutine  to  print  convosite  results  for  an  entire  ^och  (to  file  and  screen) 


/ 


void  Print_Epoch() 

{  /*  Kean  squared  error  per  output  node,  wd  learning  step  size  */ 

fprintf(  EPOCHS,  "tg.Sf  %8.6f\f,  J[l)  /  data[c)  .all_data,  alpha  )  ; 

/•  Straight  count  of  signatures  */ 
fprintf(  EPOCHS,  •%4d  *,  epoch_right_signatures  ); 

fprintf(  EPOCHS,  *%4.1f%%\t*,  < float ) epoch_right_signatures  / 

(float)data[c] .all_data*100.0  ): 

fprintf(  EPOCHS,  ■%4d  ',  epoch_good_8ignatures  ); 

fprintf(  EPOCHS,  *%4.1f%%\t',  ( float )epoc)x.good_signatures  / 

(float)data[c] .all_data*100.0  ); 

/*  Voting  scheme  results  •/ 

f print f(  EPOCHS,  •%3d  •,  right_sequences_vote  ); 

fprintf(  EPOCHS,  •%4.1f%%\t*,  ( float )right_8equences_vote  / 

(float)data[c] .sequences*100.0  ); 

fprintf(  EPOCHS,  ■%3d  ■,  goodLaequence8_vote  ); 

fprintf(  EPOCHS,  •%4.1f%%\t*,  ( float )good_8equence8_vote  / 

(float)data[c] .  8equence8*100.0  )  ,- 

/*  Average  response  results  */ 

f print f(  EPOCHS,  *%3d  *,  right_sequence8_mean  ); 

fprintf(  EPOCHS,  *%4.1f%%\t“,  ( float )right_sequence8_mean  / 

(float)data[c] .sequence8*100.0  ): 

fprintfC  EPOCHS,  *%3d  *,  goodLsequences_mean  ) ; 

fprlntf(  EPOCHS,  *%4.1f%%\t*,  ( float )goocL.sequences_mean  / 

(float)data[c] .8equences*100.0  ) ; 

/*  Last  time  step  results  */ 

fprintf(  EPOCHS,  •%3d  *,  right_sequences_last  ); 
fprintfC  EPOCHS,  •%4.1f%%\t*,  (float) right_sequences_la8t  / 

(float)data(c} .sequences^lOO.O  ); 

fprlntf(  EPOCHS,  '%3d  ',  goo<l_sequences_last  ); 

fprintf(  EPOCHS,  •%4.1f%%\t*,  ( float )good_8equence8_la8t  / 

(float)dataCc] .sequence8*100.0  ); 

f print f(  EPOCHS,  "Xn*  ) ; 

printf(  •%9,6f  %8.6f\f,  J[l]  /  data[cl .all_data,  alpha  ); 

prlntf(  •%4.1f%%\t*,  ( float )epoch_rlght_signatures  /  ( float) data [c] .all_data  *  100.0  ) ; 
prlntf(  •%4.’f%%\t*,  ( float )epoch_good_slgnatures  /  (float)data[c]  .all_data  •  100.0  )  ,• 

prlntf(  ■%4.1f%%\t*,  (float) right_sequences_vote  /  ( float) data [c] .sequences  *  100.0  ) ; 
printf(  '%4.1f%%\t*,  ( float )good_8equence8_vote  /  ( float) data [c ] .8equences  *  100.0  ) ; 

prlntf(  '%4.1f%%\t*,  ( float )right_8equences_aiean  /  ( float) data [c] .sequences  *  100.0  ),* 
prlntf(  *%4.1f%%\t*,  ( float )good-8equences_8tean  /  ( float) data [c]  .sequences  *  100.0  ) ; 

prlntf(  *%4.1f%%\t*,  ( float )rlght_8equences_last  /  (float)data[c] .sequences  *  100.0  ) ; 
prlntf(  *%4.1f«%\t*,  ( float )good_sequences_last  !  (float)data[c] .sequences  *  100.0  ) ; 

printf(  ‘Xn*  ); 

return; 

) 

/*  end  PR1»IT_EP0CH  */ 

/*  end  RBCUIUtENT  */ 
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Appendix  D.  UTILITIES  Source  Code 


This  appendix  contains  the  UTILITIES  source  code.  These  subroutines  are  used 
by  function  calls  from  FORMAT_RCST  and  RECURRENT. 

/*  utilities. c  ••*****************•*••••*•*••**•»••**»***•*•**•••**»*****••••••••*/ 

#include  <8tdio.h> 

#include  <stdlib.h> 

#include  <inath.h> 


void  Bxit_>lessage  (  char  *me8sage  ) 

{ 

print£(  '%s\nexit\n',  message  ); 
exit (  1  ) ; 


FILE  *0pen_File2(  char  *pre,  char  *extl,  char  *mode  ) 

{ 

char  *new_name; 

FILE  *NEW_FILE; 

new_name  s  iiialloc(  strlen(  pre  )  *  strlen(  extl  )  1  ) ; 

strep/ (  new_name.  pre  ); 
strcat(  new_naaie.  extl  ); 

NEW_FII<E  s  £open<  new_name,  mode  ); 
i£(  NEW_FIhE  NULL  ) 

{ 

printfC  'Cannot  find  file;  %s\nexlt\n*,  new_name  ); 
exit(  1  ); 

) 

prlnt£(  *%8\t%s\n*,  mode,  new_name  ); 
return  NBW_FILE; 


FILE  'OpenJFileS (  char  *pre,  char  *extl,  char  *ext2,  char  *mode  ) 

{ 

char  *new_naae; 

FILE  •NEW.FILE; 

new_name  s  malloc(  strlenC  pre  )  +  strlenC  extl  )  *  strlen(ext2  )  ■•■  1  ) ; 
strcpy(  new_name,  pre  ); 
strcat(  new_name,  extl  ); 
strcat(  new_naM,  ext2  ); 

MBW_FILE  >  fopen(  new_naffla,  mode  ); 
if(  NBH_riLB  *m  NULL  ) 

( 

printf(  'Cannot  find  files  %a\nexit\n*,  new_name  ); 
exit(  1  ); 
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) 

print£(  '%s\t%8\n*,  mode,  new_name  ); 
return  MEW_piLE; 


FILE  *Open_File4(  char  ‘pre,  char  •extl,  char  •ext2,  char  *ext3,  ch2tr  *mode  ) 
{ 

char  *neM'_name: 

FILE  *NEW_FILE; 

new_naffle  =  malloc(  strlen(  pre  )  +  8trlen(  extl  >  +  8trlen(  ext2  ) 

+  8trlen(  ext3  )  +  1  ) ; 

8trcpy(  new_iiame,  pre  ): 

8trcat  (  new_iuuDe,  extl  )  ; 

8trcat(  new_name,  ext2  ); 

8trcat (  new_name,  ext3  ) ; 

KEW_FILE  =  £open(  new.name,  mode  ); 
i£(  NEW_FILE  NULL  ) 

{ 

prlnt£(  'Cannot  find  file:  %8\nexlt\n*,  new_name  ); 
exlt(  1  ); 

} 

print£(  '%8\t%8\n*,  mode,  new_name  ); 
return  NEW_FILE; 


int  <jet_lnteger<  FILE  ‘TEMP,  int  lower_limit  ) 

{ 

int  variable; 
char  comment8[100] ; 

£8can£(  TEMP,  *%d*,  ^variable  ) ; 
fgetB(  commenta,  100,  TEMP  ) ; 
i£(  variable  <  lower_limlt  ) 

Bxit_He88a9e (  'Integer  error  in  aetup  file'  ); 

return  variable; 

} 


/*  UNIFOIULJUUIDOM  ia  the  RANI  routine  from  Numerical  Recipiea  in  C.  */ 


•define  Ml 
•define  lAl 
•define  ZCl 
•define  RMl 
•define  M2 
•define  IA2 
•define  IC2 
•define  RM2 
•define  M3 
•define  IA3 
•define  IC3 


259200 

7141 

54773 

(  1.0  /  Ml  ) 
134456 
8121 
28411 

(  1.0  /  M2  ) 
243000 
4561 
51349 


extern  float  Uniform_jtandom(  int  *integer_8eed  ) 
{ 
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static  Int  iff  =  0; 
static  long  ixl; 
static  long  1x2; 
static  long  1x3; 
static  int  j; 
static  float  r(98]; 
float  tssip; 

If  (  *lnteger_seed  <011  Iff  =s  0  ) 

{ 

iff  s  1; 

ixl  =  (  ICl  -  (  *lnteger_seed  ))  %  Ml; 
ixl  s  (  lAl  •  ixl  +  ICl  )  %  Ml; 

1x2  s  1x1  %  M2; 

ixl  «  (  lAl  *  1x1  4-  ICl  )  %  Ml; 

1x3  s  ixl  %  M3; 

for(  j  =  1;  j  <=  97;  j++  ) 

{ 

ixl  =  (  lAl  *  ixl  +  ICl  )  %  Ml; 

1x2  s  (  IA2  *  1x2  4  IC2  )  t  M2; 
r[j]  =  (  ixl  ♦  1x2  *  RM2  )  *  RMl; 

} 

*lnteger_seed  s  1; 

) 

ixl  =  (  lAl  *  ixl  +  ICl  )  %  Ml; 

1x2  s  (  IA2  *  1x2  4  IC2  )  %  M2; 

1x3  =  (  IA3  •  1x3  +  IC3  )  %  M3; 

J  =  1  ♦  ((  97  *  1x3  )  /M3); 

if(  J  >  97  I  I  J  <  1  ) 

Exit_Maasage (  ‘UnifoniLJtandom!  positive  seed  value*  ); 
tesip  =  r[j]; 

r(j]  a  (  ixl  ♦  1x2  *  RM2  )  *  RMl; 
return  tenp; 

} 

tundef  Ml 
tundef  lAl 
iundef  ICl 
*ux)daf  RMl 
•undef  N2 
iundef  1A2 
tundef  1C2 
iundef  RM2 
iundef  M3 
itindef  XA3 
iundef  IC3 


/*  GAUSSIAH-RANDOH  Is  the  GASRAN  routine  froa  NuMrical  Recipies  in  C.  */ 

extern  float  Gausslan^JtandoM(  int  *integer_seed  ) 

{ 

static  int  Iset  *  0; 
static  float  gset; 
float  fac; 
float  r; 
float  vl; 
float  v2; 

float  Unlfota_Randoa() ; 

lf(  iset  M  0  ) 

{ 
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do 

t 

vl  z  2.0  *  Unif ornL.Random (  integer.seed  )  -  1.0; 
v2  =  2.0  *  Uni£om_Randoin(  lnte9er_aeed  )  -  1.0; 
r  =  vl  •  vl  +  v2  *  v2; 

) 

vdille{  r  >=  1.0  II  r  ==  0.0  ); 

£ac  z  sqrt (  -2.0  •  log (  r  >  /  r  ) ; 
gs«t  z  vl  •  £«c; 

Iset  z  1; 
return  v2  *  £ac; 

) 

else 

{ 

iset  z  0; 
return  gset; 

} 

) 


int  *Integer_Vector(  int  nl,  int  nh)  /*  from  Humerical  Recipies  in  C.  */ 

{ 

int  *v; 

V  z  (  int  *  )  malloci  (unsigned)!  nh  -  nl  4-  1  )  *  sizeo£(  int  )); 
if  (  IV  ) 

Bxit_He8sage (  •lnteger_Vector!  allocation  failure*  ); 

V  -z  nl; 


return  v; 

} 


float  *Vector(  int  nl<  int  nh  )  /*  fron  Nuiaerical  Recipies  in  C.  */ 

( 

float  •vs 

V  z  (  float  *  )  aalloc(  (unsigned)!  nh  -  nl  >  1  )  •  slzeof(  float  )); 
if  (  !v  ) 

Bxit_|le88age (  'Vector:  allocation  failure*  ); 

V  -z  nl; 


return  v; 

) 


int  **Integer_Hatrix(  int  nrl,  int  nrh,  int  ncl.  int  nch  ) 

/*  froa  Nuaerical  Recipies  in  C.  •/ 

( 

int  i; 
int  *•■; 

■  z  (  int  **  )  nalloc!  (unsigned)!  nrh  -  nrl  ♦  1  )  *  sizeof!  int*  )); 

!£(!■) 

Bxlt_|lassage(  *Integer_>iatrix:  allocation  failure  1*  ); 

■  -z  nrl; 

for(  1  z  nrl;  1  <z  nrh;  i+i-  ) 

( 

■  [i]  z  (  int  *  )  nalloc!  (unsigned)!  nch  -  ncl  4-  1  )  *  sizeof!  int  )); 
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if  (  !m[l]  ) 

Bxit_Hes8age(  'Integerjtatrlx:  allocation  failure  2*  ) ; 
m[i]  -=  ncl; 


return  m; 

) 


float  **Matrix(  int  nrl,  int  nrh,  int  ncl,  int  nch  ) 

/*  from  Numerical  Recipies  in  C.  */ 

{ 

int  i; 
float  “m; 

m  =  (  float  **  )  mallocf  (unsigned) (  nrh  -  nrl  *  1  )  *  sizeof(  float*  )); 
if  (  !m  ) 

Exlt_Ne8sage (  ‘Matrix:  allocation  failure  1*  ); 
m  -=  nrl; 

for(  1  s  nrl;  i  <s  nrh;  i-f-f  ) 

{ 

m[i}  s  (  float  *  )  malloc(  (imslgned)  (  nch  -  ncl  1  )  *  sizeof(  float  ) )  ; 
if  (  !m[l]  ) 

Exlt_Hee8age (  ‘Matrix;  allocation  failure  2‘  ); 
mti]  -=  ncl; 

) 

return  m; 

) 


float  ***Matrix_3D(  int  nrl,  int  nrh,  int  ncl,  int  nch,  int  ndl,  int  ndh  ) 

/*  from  the  REC3)ET  computer  code  */ 

{ 

int  i,  j; 
float  •**m; 

m  s  (float  ***)  malloc(  (unsigned)  (  nrh  -  nrl  1  )  *  sizeof(  float**  )); 
if  (  !m  ) 

Bxit_Me88age(  ‘Natrix_3P:  allocation  failure  1’  ); 
m  -s  nrl; 

for(  i  a  nrl;  i  <=  nrh;  i-*'-:-  ) 

{ 

m[i]  s  (float  **)  malloc(  (unsigned)  (  nch  -  ncl  4-  1  )  *  sizeof(  float*  )); 
if  (  !m[i]  ) 

Bxlt_He88age (  ‘Matrix_3D:  allocation  failure  2‘  ); 
m(l}  -M  ncl; 

for(  j  =  ncl;  j  <=  nch;  j-»-+  ) 

{ 

m[i][j]  *  (float  *)  malloc(  (  unsigned  )(  ndh  -  ndl  4-  1  )  *  sizeof(  float  )); 
if  (  lm(i][j]  ) 

Bxit_Me88age(  ‘Matrlx_3D:  allocation  failure  3*  ); 
m(i](j]  —  ndl; 

) 

) 

return  m; 

) 

/•  end  UTILITIBS  */ 
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